Method and device for controlling transmission or reception of data in wireless communication system

ABSTRACT

The present disclosure relates to a method and device for controlling transmission or reception of data in a wireless communication system, an operating method of a transmission user equipment (UE) in a wireless communication system including: obtaining a point cloud by photographing an object; transmitting, to a reception UE, a message including a parameter for transmission and reception of the point cloud, wherein the parameter for transmission and reception of the point cloud includes at least one of a parameter associated with a direction of the object or a space parameter associated with the object; receiving, from the reception UE, a response message including an application parameter of the reception UE, wherein the application parameter of the reception UE is determined based on the parameter for transmission and reception of the point cloud and a channel state of the reception UE; compressing the point cloud, based on the application parameter of the reception UE, and transmitting, to the reception UE, the compressed point cloud.

TECHNICAL FIELD

The present disclosure relates to a method and device for controllingtransmission or reception of data in a wireless communication system.

BACKGROUND ART

In order to meet increasing demand with respect wireless data trafficafter the commercialization of 4^(th) generation (4G) communicationsystems, efforts have been made to develop 5^(th) generation (5G) orpre-5G communication systems. For this reason, 5G or pre-5Gcommunication systems are called ‘beyond 4G network’ communicationsystems or ‘post long term evolution (post-LTE)’ systems. In order toachieve high data rates, implementation of 5G communication systems inan ultra-high frequency millimeter-wave (mmWave) band (e.g., a60-gigahertz (GHz) band) is being considered. In order to reduce pathloss of radio waves and increase a transmission distance of radio wavesin the ultra-high frequency band for 5G communication systems, varioustechnologies such as beamforming, massive multiple-input andmultiple-output (massive MIMO), full-dimension MIMO (FD-MIMO), arrayantennas, analog beamforming, and large-scale antennas are beingstudied. Also, in order to improve system networks for 5G communicationsystems, various technologies such as evolved small cells, advancedsmall cells, cloud radio access networks (Cloud-RAN), ultra-densenetworks, device-to-device communication (D2D), wireless backhaul,moving networks, cooperative communication, coordinated multi-points(CoMP), and received-interference cancellation have been developed. Inaddition, for 5G communication systems, advanced coding modulation (ACM)technologies such as hybrid frequency-shift keying (FSK) and quadratureamplitude modulation (QAM) (FQAM) and sliding window superpositioncoding (SWSC), and advanced access technologies such as filter bankmulti-carrier (FBMC), non-orthogonal multiple access (NOMA), and sparsecode multiple access (SCMA), have been developed.

The Internet has evolved from a human-based connection network, wherehumans create and consume information, to the Internet of things (IoT),where distributed elements such as objects exchange information witheach other to process the information. Internet of everything (IoE)technology has emerged, in which the IoT technology is combined with,for example, technology for processing big data through connection witha cloud server. In order to implement the loT, various technologicalelements such as sensing technology, wired/wireless communication andnetwork infrastructures, service interface technology, and securitytechnology are required, such that, in recent years, technologiesrelated to sensor networks for connecting objects, machine-to-machine(M2M) communication, and machine-type communication (MTC) have beenstudied. In the IoT environment, intelligent Internet technology (IT)services may be provided to collect and analyze data obtained fromconnected objects to create new value in human life. As existinginformation technology (IT) and various industries converge and combinewith each other, the IoT may be applied to various fields such as smarthomes, smart buildings, smart cities, smart cars or connected cars,smart grids, health care, smart home appliances, and advanced medicalservices.

Various attempts are being made to apply 5G communication systems to theloT network. For example, technologies related to sensor networks, M2Mcommunication, and MTC are being implemented by using 5G communicationtechnology using beamforming, MIMO, and array antennas. Application ofcloud radio access network (Cloud-RAN) as the above-described big dataprocessing technology may be an example of convergence of 5Gcommunication technology and IoT technology.

As various services can be provided due to the aforementioneddevelopment of wireless communication systems, there is a demand for amethod for seamlessly providing the services.

DISCLOSURE Technical Solution

Based on discussions described above, the present disclosure provides adevice and method for effectively controlling transmission or receptionof data in a wireless communication system.

DESCRIPTION OF DRAWINGS

FIG. 1 illustrates an example of a network structure of a 3^(rd)generation (3G) communication network.

FIG. 2 illustrates an example of a network structure of a long termevolution (LTE) communication system.

FIG. 3 illustrates user plane (UP) protocol architecture of a LTE modem.

FIG. 4 illustrates architecture of a speech or video codec, andreal-time transport protocol (RTP)/user datagram protocol (UDP)/Internetprotocol (IP) protocol of a user equipment (UE) that supports voice overLTE (VoLTE).

FIG. 5 illustrates a structure of a codec mode request (CMR) message.

FIG. 6 illustrates a structure of a temporary maximum media bit-raterequest (TMMBR) message.

FIG. 7 illustrates an example in which a media bitrate of a video or aspeech transmitted by the other UE is adjusted by using a controlmessage.

FIG. 8 illustrates an example of a camera for measuring a point cloud.

FIG. 9 illustrates an example of displaying a point cloud in athree-dimensional (3D) space.

FIG. 10 illustrates an example of generating a patch of a point cloud.

FIG. 11 illustrates an example of a color information patch and adistance information patch.

FIG. 12 illustrates a procedure for generating a bitstream by using apatch of a point cloud.

FIG. 13 illustrates a scenario in which a point cloud is transmitted byusing a 5^(th) generation (5G) network according to an embodiment of thepresent disclosure.

FIG. 14 illustrates the protocol architecture for point cloudtransmission or reception according to an embodiment of the presentdisclosure.

FIG. 15 illustrates a block diagram for transmission of a point cloudaccording to an embodiment of the present disclosure.

FIG. 16 illustrates a flowchart of an operating method of a transmissionUE according to an embodiment of the present disclosure.

FIG. 17 illustrates a flowchart of an operating method of a reception UEaccording to an embodiment of the present disclosure.

FIG. 18 illustrates a flowchart of a method of determining anapplication parameter of a reception UE according to an embodiment ofthe present disclosure.

FIG. 19 illustrates a flowchart of a method of determining anapplication parameter of a reception UE according to an embodiment ofthe present disclosure.

FIG. 20A illustrates an example in which a point cloud is illustrated ina 3D space.

FIG. 20B illustrates an example in which a part of a point cloud istransmitted

FIG. 20C illustrates an example in which a part of a point cloud istransmitted according to an embodiment of the present disclosure.

FIG. 21 illustrates an example of a transmission message of atransmission UE which is generated based on a space parameter accordingto an embodiment of the present disclosure.

FIG. 22 illustrates an example of a transmission message of atransmission UE according to an embodiment of the present disclosure.

FIG. 23 illustrates an example of a transmission message of atransmission UE according to an embodiment of the present disclosure.

FIG. 24 illustrates an example of a response message to a transmissionmessage of a transmission UE according to an embodiment of the presentdisclosure.

FIG. 25 illustrates a procedure of negotiation between a transmission UEand a reception UE for transmission of a point cloud according to anembodiment of the present disclosure.

FIG. 26 is a flowchart of a response message generation procedure in thereception UE according to an embodiment of the present disclosure.

FIG. 27 illustrates an example of metadata transmitted from a receptionUE to a transmission UE according to an embodiment of the presentdisclosure.

FIG. 28 illustrates an example of metadata transmitted from a receptionUE to a transmission UE according to an embodiment of the presentdisclosure.

FIG. 29 illustrates an example of metadata transmitted from a receptionUE to a transmission UE according to an embodiment of the presentdisclosure.

FIG. 30A illustrates an example of metadata transmitted from a receptionUE to a transmission UE according to an embodiment of the presentdisclosure.

FIG. 30B illustrates an example of metadata transmitted from a receptionUE to a transmission UE according to an embodiment of the presentdisclosure.

FIG. 31 illustrates a flowchart of a procedure in which a transmissionUE transmits point cloud media, based on a message received from areception UE, according to an embodiment of the present disclosure.

FIG. 32A illustrates an example in which a transmission UE provides anannotation to a reception UE according to an embodiment of the presentdisclosure.

FIG. 32B illustrates an example in which a transmission UE provides anannotation to a reception UE according to an embodiment of the presentdisclosure.

FIG. 33A illustrates an example in which a reception UE provides atransmission UE with a response corresponding to an annotation accordingto an embodiment of the present disclosure.

FIG. 33B illustrates an example in which a reception UE provides atransmission UE with a response corresponding to an annotation accordingto an embodiment of the present disclosure.

FIG. 34 illustrates an example of a method of indicating, via anannotation, a body part of human in a 3D image according to anembodiment of the present disclosure.

FIG. 35 illustrates an example of a polygon file format (PLY) format ofa point cloud according to an embodiment of the present disclosure.

FIG. 36 illustrates a block diagram of a configuration of a transmissionUE or a reception UE according to an embodiment of the presentdisclosure.

FIG. 37 illustrates a block diagram of a detailed configuration of atransmission UE or a reception UE according to an embodiment of thepresent disclosure.

BEST MODE

According to an embodiment of the present disclosure, an operatingmethod of a transmission user equipment (UE) in a wireless communicationsystem may include obtaining a point cloud by photographing an object,transmitting, to a reception UE, a message including a parameter fortransmission and reception of the point cloud, wherein the parameter fortransmission and reception of the point cloud includes at least one of aparameter associated with a direction of the object or a space parameterassociated with the object, receiving, from the reception UE, a responsemessage including an application parameter of the reception UE, whereinthe application parameter of the reception UE is determined based on theparameter for transmission and reception of the point cloud and achannel state of the reception UE, compressing the point cloud, based onthe application parameter of the reception UE, and transmitting, to thereception UE, the compressed point cloud.

According to an embodiment of the present disclosure, an operatingmethod of a reception UE in a wireless communication system may includereceiving, from a transmission UE, a message including a parameter fortransmission and reception of a point cloud, and obtaining the pointcloud by photographing an object, wherein the parameter for transmissionand reception of the point cloud includes at least one of a parameterassociated with a direction of the object or a space parameterassociated with the object, determining an application parameter of thereception UE, based on a channel state of the reception UE and theparameter for transmission and reception of the point cloud,transmitting, to the transmission UE, a response message including thedetermined application parameter of the reception UE, receiving, fromthe transmission UE, the point cloud, wherein the point cloud iscompressed based on the application parameter of the reception UE, anddisplaying an image associated with the object, based on the compressedpoint cloud.

According to an embodiment of the present disclosure, a transmission UEin a wireless communication system may include a transceiver, and atleast one processor configured to obtain a point cloud by photographingan object, transmit, to a reception UE via the transceiver, a messageincluding a parameter for transmission and reception of the point cloud,wherein the parameter for transmission and reception of the point cloudincludes at least one of a parameter associated with a direction of theobject of a space parameter associated with the object, receive, fromthe reception UE via the transceiver, a response message including anapplication parameter of the reception UE, wherein the applicationparameter of the reception UE is determined based on the parameter fortransmission and reception of the point cloud and a channel state of thereception UE, compress the point cloud, based on the applicationparameter of the reception UE, and transmit, to the reception UE via thetransceiver, the compressed point cloud.

According to an embodiment of the present disclosure, a reception UE ina wireless communication system may include a transceiver, and at leastone processor configured to receive, from a transmission UE via thetransceiver, a message including a parameter for transmission andreception of a point cloud, and obtain the point cloud by photographingan object, wherein the parameter for transmission and reception of thepoint cloud includes at least one of a parameter associated with adirection of the object or a space parameter associated with the object,determine an application parameter of the reception UE, based on achannel state of the reception UE and the parameter for transmission andreception of the point cloud, transmit, to the transmission UE via thetransceiver, a response message including the determined applicationparameter of the reception UE, receive, from the transmission UE via thetransceiver, the point cloud, wherein the point cloud is compressedbased on the application parameter of the reception UE, and display animage associated with the object, based on the compressed point cloud.

MODE FOR INVENTION

Hereinafter, embodiments of the present disclosure will now be describedmore fully with reference to the accompanying drawings. In thedescriptions of the present disclosure, detailed explanations of therelated art are omitted when it is deemed that they may unnecessarilyobscure the essence of the present disclosure. The terms used in thespecification are defined in consideration of functions used in thepresent disclosure, and can be changed according to the intent orcommonly used methods of users or operators. Accordingly, definitions ofthe terms are understood based on the entire descriptions of the presentspecification.

Advantages and features of the present disclosure and methods ofaccomplishing the same may be understood more readily by reference tothe following detailed descriptions of embodiments and accompanyingdrawings of the present disclosure. However, the present disclosure maybe embodied in many different forms and should not be construed as beinglimited to the embodiments set forth herein. Rather, these embodimentsare provided so that the present disclosure will be thorough andcomplete and will fully convey the concept of the present disclosure toone of ordinary skill in the art, and the present disclosure will onlybe defined by the appended claims. Throughout the specification, likereference numerals refer to like elements.

Here, it will be understood that each block of flowchart illustrations,and combinations of blocks in the flowchart illustrations, may beimplemented by computer program instructions. The computer programinstructions may be provided to a processor of a general-purposecomputer, special purpose computer, or other programmable dataprocessing apparatus, such that the instructions, which are executed viathe processor of the computer or other programmable data processingapparatus, generate means for performing functions specified in theflowchart block(s). The computer program instructions may also be storedin a computer-executable or computer-readable memory that may direct thecomputer or other programmable data processing apparatus to function ina particular manner, such that the instructions stored in thecomputer-executable or computer-readable memory may produce an articleof manufacture including instruction means that perform the functionsspecified in the flowchart block(s). The computer program instructionsmay also be loaded onto the computer or other programmable dataprocessing apparatus to cause a series of operational steps to beperformed on the computer or other programmable apparatus to produce acomputer implemented process such that the instructions that areexecuted on the computer or other programmable apparatus provideoperations for implementing the functions specified in the flowchartblock(s).

In addition, each block may represent a module, segment, or portion ofcode, which includes one or more executable instructions for performingspecified logical function(s). Also, it should be noted that in somealternative implementations, the functions noted in the blocks may occurout of the order. For example, two blocks shown in succession may infact be executed substantially concurrently or the blocks may sometimesbe executed in the reverse order, depending upon the functionalityinvolved.

Here, the term “... unit” as used in the present embodiment refers to asoftware or hardware component, such as field-programmable gate array(FPGA) or application-specific integrated circuit (ASIC), which performscertain tasks. However, the term “... unit” does not mean to be limitedto software or hardware. A “... unit” may be configured to be in anaddressable storage medium or configured to operate one or moreprocessors. Thus, according to an embodiment, a “... unit” may include,by way of example, components, such as software components,object-oriented software components, class components, and taskcomponents, processes, functions, attributes, procedures, subroutines,segments of program code, drivers, firmware, microcode, circuitry, data,databases, data structures, tables, arrays, and variables. Thefunctionality provided in the elements and “... units” may be combinedinto fewer elements and “... units” or further separated into additionalelements and “... units”. Further, the elements and “... units” may beimplemented to operate one or more central processing units (CPUs) in adevice or a secure multimedia card. Also, according to embodiments, a“... unit” may include one or more processors.

In the description of the present disclosure, detailed descriptions ofthe related art are omitted when it is deemed that they mayunnecessarily obscure the essence of the present disclosure.Hereinafter, embodiments the present disclosure will be described indetail with reference to accompanying drawings.

Hereinafter, terms identifying an access node, terms indicating networkentities, terms indicating messages, terms indicating an interfacebetween network entities, and terms indicating various pieces ofidentification information, as used in the following description, areexemplified for convenience of descriptions. Accordingly, the presentdisclosure is not limited to terms to be described below, and otherterms indicating objects having equal technical meanings may be used.

In the descriptions below, “physical channel” and “signal” may beinterchangeably used with “data” or “control signal.” For example, aphysical downlink shared channel (PDSCH) is a term indicating a physicalchannel on which data is transmitted from a base station to a terminalHowever, the PDSCH may also be referred to as the data. That is, in thepresent disclosure, the expression “transmit a physical channel” may beequally interpreted as the expression “transmit data or a signal on aphysical channel”.

Hereinafter, in the present disclosure, higher layer signaling indicatesa signal transmission scheme by which a base station transmits a signalto a terminal by using a downlink (DL) data channel of a physical layeror a terminal transmits a signal to a base station by using an uplink(UL) data channel of a physical layer. Higher layer signaling may beunderstood as radio resource control (RRC) signaling or media accesscontrol (MAC) control element (CE), or the like.

For convenience of descriptions, the present disclosure uses terms andnames defined in the 3^(rd) Generation Partnership Project (3GPP) NewRadio (NR). However, the present disclosure is not limited to theseterms and names, and may be equally applied to systems conforming toother standards. In the present disclosure, a next-generation node B(gNB) that is a base station of NR may be interchangeably used with anevolved node B (eNB) that is a base station of long term evolution(LTE), for convenience of descriptions. That is, a base stationdescribed by an eNB may represent a gNB. Also, the term “terminals” mayrefer to not only mobile phones, machine type communication (MTC)devices, narrowband Internet of Things (NB-IoT) devices, and sensors butalso other wireless communication devices.

Hereinafter, a base station is an entity that allocates resources to aterminal, and may be at least one of a gNode B (gNB), an eNode B (eNB),a Node B, a base station (BS), a radio access unit, a BS controller, ora node on a network. A terminal may include a user equipment (UE), amobile station (MS), a cellular phone, a smartphone, a computer, or amultimedia system capable of performing a communication function.However, the present disclosure is not limited to the above example.

The 2^(nd) generation (2G) network such as the Global System for MobileCommunications (GSM), Interim Standard 95 (IS-95), or the like whichcould provide a basic service such as a voice call and a short messageservice (SMS) has evolved, according to the developments of mobilecommunication technologies, to the 3^(rd) generation (3G) network suchas Wideband Code-Division Multiple Access (W-CDMA), cdma2000, or thelike which can provide a video call service, and in the 4^(th)generation (4G) network such as LTE, a large amount of data and imagewith high quality can be transmitted with high speed. In the 5^(th)generation (5G) network using the NR wireless communication technology,the use of the point cloud compression technology is being considered totransmit a three-dimensional (3D) stereoscopic image. The presentdisclosure relates to a device and method for applying the point cloudcompression technology to the 5G network in a situation where atransmission condition of a network deteriorates or the network isheavily overloaded.

Mobile communication networks may have a limited transmission capacitydue to physically limited radio frequency resources and the long timeand huge investment costs required to build various wired or wirelessinfrastructures. However, many UEs in a dense area may simultaneouslymake connections to a mobile communication network to use call servicesor Internet or attempt to download data or use media streaming services.Here, when the capacity of the network is insufficient, UEs may not beable to properly use such services.

This network overload such as the insufficient network capacitydescribed above may occur at rush hour in big cities or in an eventwhere many people are gathered in a narrow space. When call trafficsharply increases, a radio network controller (RNC) for controlling BSsin a circuit-switched 3G (e.g., Wideband Code Division Multiple Access(W-CDMA)) network decreases bitrates of speech codecs equipped in UEsand the network so as to overcome communication disorder caused by thenetwork overload. The speech bitrate, which has been temporarilyreduced, of each UE may be gradually increased when the network hassufficient capacity.

FIG. 1 illustrates an example of a network structure of a 3^(rd)generation (3G) communication network. In detail, FIG. 1 illustrates thestructure of the 3G network including a UE, a BS (e.g., NodeB), a radionetwork controller (RNC), and a mobile switching center (MSC).

Referring to FIG. 1 , the network of FIG. 1 is connected to anothermobile communication network and a public switched telephone network(PSTN). In the 3G network, speech may be compressed and reconstructed byadaptive multi-rate (AMR) codecs. Here, the AMR codecs are installed inthe UE and the MSC and provide bidirectional call services. The MSC mayconvert the speech compressed by the AMR codec to a pulse-codemodulation (PCM) format and transmit the speech to the PSTN, orinversely, may receive a speech with PCM format, may compress the speechby the AMR codec, and then may transmit it to a BS. The RNC may alwayscontrol call bitrates of the speech codecs installed in the UE and theMSC, using a codec mode control (CMC) message.

However, after introduction of a packet switched network in the 4G, thespeech codec is only installed in the UE, and a speech frame compressedat intervals of 20 ms may not be reconstructed by a BS or a network nodelocated in the middle of a transmission path but may be transmitted toand reconstructed by the other UE. In the present disclosure, the otherUE may indicate a UE that transmits or receives data with a particularUE or that performs video call.

FIG. 2 illustrates an example of a network structure of a LTEcommunication system.

Referring to FIG. 2 , the network structure of 4G (i.e., LTE) isillustrated. Here, a speech codec is installed only in a UE, and each UEmay adjust a speech bitrate of the other UE by using a codec moderequest (CMR) message. In FIG. 2 , an eNodeB that is a BS may be dividedinto a remote radio head (RRH) in charge of a radio frequency (RF)function and a digital unit (DU) in charge of digital signal processingof a modem. The eNodeB may be connected to an Internet Protocol (IP)backbone network via a serving gateway (S-GW) and a packet data networkgateway (P-GW). The IP backbone network may be connected to a mobilecommunication network of another service provider or internet.

FIG. 3 illustrates user plane (UP) protocol architecture of a LTE modem.

Referring to FIG. 3 , illustrated is the UP protocol architecture of theLTE modem which is used to transmit a compressed speech or video framein the Voice over LTE (VoLTE) using an LTE network. The protocolstructure of FIG. 3 consists of packet data convergence protocol (PDCP),radio link control (RLC), media access control (MAC) and physical (PHY)layers.

FIG. 4 illustrates architecture of a speech or video codec, andreal-time transport protocol (RTP) user datagram protocol (UDP)/Internetprotocol (IP) protocol of UE that supports VoLTE.

An IP layer located at the bottom of the protocol architecture of FIG. 4may be connected to the PDCP at the top of the protocol architectureshown in FIG. 3 . RTP/UDP/IP headers may be added to a media framecompressed by the speech or video codec and may be transmitted to theother UE via the LTE network. Also, the UE may receive, via the network,a media packet compressed and transmitted by the other UE, mayreconstruct the media, and thus, a user of the UE may listen and viewthe media with a speaker and a display. Here, even when a speech and avideo packet which are simultaneously captured and compressed are notreceived in the same time, the UE may synchronize two media by usingtimestamp information of an RTP protocol header, and thus, the user maylisten and view them.

When the UE is located at a boundary with a neighboring cell or when theUE experiences poor transmission or it is predicted that the UE is toexperience poor transmission due to a huge amount of data transmissionand reception within a cell, the eNodeB may mark a congestionexperienced (CE) state in an IP header of a packet being transmitted orreceived to or from the UE, by using an explicit congestion notification(ECN) function, or may display a currently-available bitrate on acontrol entity (CE) of a MAC header. The UE may identify a change in atransmission state, based on information such as the CE state or theavailable bitrate.

FIG. 5 illustrates a structure of a CMR message.

Referring to FIG. 5 , illustrated is the CMR message by which the otherUE adjusts a bitrate for compressing a speech, according to a change ina transmission state during call between a UE and the other UE. FIG. 5may correspond to payload formats of FIG. 4 . A speech frame coded by aspeech codec displayed “Speech” in FIG. 4 may be added a CMR field todisplay a bitrate requested for a speech codec of the other UE to use. Afour-bit table of contents (ToC) field is added thereto and compressed,such that a bitrate and a type of a frame to be transmitted may beindicated. The VoLTE may support speech codes including adaptivemulti-rate (AMR), adaptive multi-rate wideband (AMR-WB), enhanced voiceservices (EVS), and the like.

FIG. 6 illustrates a structure of a temporary maximum media bit-raterequest (TMMBR) message.

A CMR message may be transmitted via an RTP protocol (RTCP) as well aspayload formats. FIG. 6 illustrates the structure of the TMMBR messagethat is included and transmitted in during call so as to dynamicallyadjust a bitrate of a video codec installed in the other UE. When theother UE receives the TMMBR message, the other UE may maintain a bitrateof a compressed video at Mantissa × 2^(Exp) bps or less. Here, thebitrate of the compressed video may be equal to or smaller than abitrate negotiated before a video call starts.

FIG. 7 illustrates an example in which a media bitrate of a video or aspeech transmitted by the other UE is adjusted by using a controlmessage.

Referring to FIG. 7 , illustrated is the example in which a UE adjustsduring call a media bitrate of a video or a speech transmitted by theother UE, by using a control message such as CMR or TMMBR. Primaryparameters including a codec type, a media bitrate, and the like whichare used in call may be negotiated between the UE and a network by usingan IP Multimedia Subsystem (IMS). In the example of FIG. 7 , it isnegotiated such that the UE is to compress a media at b₀(kbps) andtransmit it. FIG. 7 shows a sustainable bitrate the network canmaintain, and an encoding bitrate the reception UE can adjust.

Referring to the graph of FIG. 7 , on the time axis, call started at T₀,and a change state deteriorated from T_(1a) such that a sustainablebitrate was decreased. When the media reception UE detects that b₀(kbps)which was negotiated between UEs via the IMS before the start of call isnot maintained after the start of call, the media reception UE maydetermine that a channel state deteriorates. The media reception UE maytransmit a CMR or TMMBR message to the other UE, thereby decreasing amedia bitrate to b₂. However, when a reception state continuouslydeteriorates, the media reception UE may decrease again a media bitrateof the other UE to b₃. When a channel state is recovered, the mediareception UE may gradually increase a bitrate, b₁ and b₄ and T_(2b) andT_(4b) are bitrates at which the network is sustainable and areparameters that cannot be accurately measured by media transmission andreception UEs or the network. When the channel state keepsdeteriorating, the UE may determine to stop media transmission andreception. As such, in compression and transmission of a one-dimensional(1D) media signal such as a speech and a three-dimensional (3D) mediasignal such as a video, the UE may react to a change in a network stateby adjusting a bitrate of the other UE.

FIG. 8 illustrates an example of a camera for measuring a point cloud.

Referring to FIG. 8 , illustrated is the example of the camera that isusable to measure a point cloud that is a set of points visiblyconfiguring a surface of human or an object. At least one camera may bearranged around the human or the object, and the camera may obtain Red(R), Green (G), Blue (B) values and location (X, Y, Z) information whichindicate a relative location and color information of each point of thesurface of the human or the object, and thus, may generate a pointcloud. For example, the camera that is usable to measure a point cloudmay include a pattern output unit configured to output a pattern forrecognizing a distance to human or an object, a pattern receiverconfigured to identify a shape of the human or the object, based on theoutput pattern, and an RGB camera configured to identify a color of asurface of the human or the object. However, the camera to obtain apoint cloud in the present disclosure is not limited to the example ofFIG. 8 . A scheme for storing a point cloud structure based on R, G, Bvalues and location information includes a polygon file format (PLY).FIG. 9 illustrates a point cloud of human measured by using the scheme,in a 3D space.

FIG. 9 illustrates an example of displaying a point cloud in a 3D space.

FIG. 9 illustrates an example of storing a point cloud structure basedon R, G, B values and location information by using a PLY scheme. InFIG. 9 , the point cloud of human which is measured by using the PLYscheme is displayed in a 3D space. For example, as a bitrate consumed toobtain 1,000,000 points 30 times per second is about 1.80 Gbps ((3attributes + 3 coordinations) * 10 bits * 1,000,000 points * 30 frames)which significantly exceeds the range in which the mobile communicationnetwork can economically provide, it is required to transmit points bycompressing the points to several Mbps not greatly affecting an imagequality or to store the points in a hard disk.

FIG. 10 illustrates an example of generating a patch of a point cloud.

The example of FIG. 10 illustrates a procedure for generating a patch,as a first step to compress the point cloud shown in FIG. 9 . Forexample, a hexahedron of a minimum size that can include all of pointclouds of a human shape shown in FIG. 9 may be assumed to be around thehuman shape. Then, color information of each point of a surface of ahuman shape projected onto each surface of the hexahedron, and adistance or depth between each point and an inner surface of thehexahedron may be measured. Here, each point may be projected onto onlyone surface of the hexahedron. Via the procedure described above, pointsmay be grouped on one surface of the hexahedron, and such grouped pointsmay be referred to as a patch. According to an embodiment, at least onepatch may be generated on each inner surface of the hexahedron. Withrespect to one inner surface of the hexahedron which surrounds the humanshape, patches including color information and patches includingdistance information may each be generated.

FIG. 11 illustrates an example of a color information patch and adistance information patch.

In detail, FIG. 11 illustrates a procedure for compacting, in a stillimage, color information patches and distance information patches foreasy transmission or storage. Each of still images may be compressed bya video compressor such as H.265 or the like, and thus, a bitrate may befurther decreased. Here, patches may be maximally compacted to belocated on one part of a still image. This is to increase an efficiencyof the video compressor by maximally using a space of the still image.FIG. 11 illustrates a still image 1110 in which the color informationpatches are compacted, and a still image 1120 in which the distanceinformation patches are compacted. In the still image 1110 where thecolor information patches are compacted, color patches respectivelyindicating R, G, B values may be arranged. In the still image 1120 wherethe distance information patches are compacted, patches indicatingdistance information may be arranged. Here, as a distance between thehuman shape and an inner surface of the hexahedron on which the humanshape is projected is close, the brightness of a distance informationpatch may be dimmed.

FIG. 12 illustrates a procedure for generating a bitstream by using apatch of a point cloud.

Referring to FIG. 12 , patches compressed with reference to FIGS. 10 and11 and a plurality of pieces of additional information forreconstructing the compressed patches in a 3D space may be multiplexedto generate a compressed bitstream. Then, the generated bitstream may beused in transmission and storage of the point cloud.

FIG. 13 illustrates a scenario in which a point cloud is transmitted byusing a 5G network according to an embodiment of the present disclosure.That is, FIG. 13 illustrates a situation in which the generated pointcloud is transmitted by using the 5G network.

Referring to FIG. 13 , an eNodeB, an S-GW and a P-GW of the LTE mayrespectively correspond to a gNB, a user plane function (UPF) and a datanetwork (DN) of the 5G. FIG. 13 illustrates cameras and sensors 1310, aUE 1320, and a tethered augmented reality (AR) glasses 1330.

According to an embodiment, a point cloud that is measured by thecameras and sensors 1310 and is compressed via the procedure of FIG. 12may be transmitted to the UE 1320 via the LTE using a unlicensedspectrum without via a BS (e.g., gNB), a sidelink of the 5G, or Wi-FiDirect or may be directly transmitted to the UE 1320 by using auniversal serial bus (USB)-C cable. When the USB-C is used, a largenumber of data can be transmitted at a low bitrate without an error, andthus, in this case, the point cloud may be compressed by the UE 1320,not by the cameras and sensors 1310. The UE may transmit the receivedpoint cloud to the AR glasses 1330. The AR glasses 1330 may output an ARimage of an object photographed by using the cameras and sensors 1310,based on the point cloud received from the UE 1320. FIG. 14 to bedescribed illustrates protocol architecture of the 5G network for the UE1320 to transmit the point cloud to the AR glasses 1330, the point cloudbeing received from the cameras and sensors 1310.

FIG. 14 illustrates the protocol architecture for point cloudtransmission or reception according to an embodiment of the presentdisclosure.

Referring to FIG. 14 , a point cloud photographed by cameras may beconverted into a PLY format or the like via 3D model construction. Then,the point cloud may be compressed by a point cloud codec (encoder), mayhave attached thereto a header of a transport protocol such as RTP and aheader of an IP including an address of a reception UE, and may betransferred to a 5G NR modem, and then may be transmitted to thereception UE. In an embodiment, the NR modem may include a new protocolcalled a service data adaptation protocol (SDAP) as an upper layer of aPDCP, unlike the protocol architecture of the LTE modem shown in FIG. 3.

The reception UE may reconstruct a payload, which is obtained byremoving the headers of the protocols, to a point cloud format such asPLY by using point cloud codec (decoder), may perform rendering byconsidering a field of view (FOV) of a user of the reception UE, andthen may have the point cloud projected onto a display such as ARglasses connected to the reception UE. In an embodiment, the AR glassesmay not be connected to the reception UE but may be directly connectedto a mobile communication network by using its own communicationfunction. Alternatively, in an embodiment, the AR glasses may be includein the reception UE.

The present disclosure relates to a method and device for maximallyusing a limited transmission bandwidth and managing a media quality andnetwork capacity by adjusting primary parameters of devices forgenerating, compressing, and transmitting a point cloud image on themobile communication network.

The present disclosure proposes technologies by which the cloudtransmission and reception system shown in FIG. 14 is enhanced such thata maximum number of points to be transmitted according to anetwork-available bandwidth and a display resolution of a reception UEis determined, and a point cloud compression and transmission scheme isdynamically changed between UEs so as to correspond to a change in atransmission or reception situation.

FIG. 15 illustrates a block diagram for transmission of a point cloudaccording to an embodiment of the present disclosure.

In detail, FIG. 15 particularly illustrates a configuration of blocks,among configurations of FIG. 14 , for obtaining a 3D image andgenerating a point cloud so as to transmit the point cloud. In thepresent disclosure, a UE, a service, or a server may include one or morestereoscopic cameras 1502 to obtain a 3D image, a 3D image modelingblock 1504 to generate an integrated 3D image from one or more 3D imagesobtained from the stereoscopic cameras, a point cloud pre-processor 1506to perform filtering or editing on the entirety or a part of a generatedimage and output a point cloud modified compared to an input, a 3D imagedecomposition block 1508 to decompose the point cloud into multiplepatches on a 3D space and convert the patches into different types of 2Dimages, a 2D video encoder 1510 to compress an input 2D image, amultiplexor 1512 configured to receive an input of information for patchreconstruction and the compressed 2D image, and a point cloudcompression (PCC) file format generator 1514 to store a compressed pointcloud image. For example, in the present disclosure, a transmission UEthat transmits a 3D image to a reception UE may include the stereoscopiccameras 1502, the 3D image modeling block 1504, the point cloudpre-processor 1506, the 3D image decomposition block 1508, the 2D videoencoder 1510, the multiplexor 1512, and the PCC file format generator1514. Operations performed by the stereoscopic cameras 1502 and the 3Dimage modeling block 1504 of FIG. 15 may be performed by the 3D modelconstruction of FIG. 14 . Also, operations after the point cloudpre-processor 1506 of FIG. 15 may be performed by the point cloud codec(encoder) of FIG. 14 .

FIG. 15 illustrates processing blocks for obtaining, compressing, andstoring a 3D image, and various embodiments of a configuration of theUE, the service, or the server may be available. For example, in anembodiment of the present disclosure, the stereoscopic cameras 1502 maybe implemented as a separate first UE, the 3D image modeling block 1504may be implemented as a second UE, and configurations starting from thepoint cloud pre-processor 1506 may be implemented as a third UE.

Alternatively, in another embodiment of the present disclosure, thestereoscopic cameras 1502 and the 3D image modeling block 1504 may beimplemented as a first UE, and the configurations starting from thepoint cloud pre-processor 1506 may be implemented as a second UE.

Alternatively, in another embodiment of the present disclosure, thestereoscopic cameras 1502, the 3D image modeling block 1504, and thepoint cloud pre-processor 1506 may be implemented as a first UE, andconfigurations starting from the 3D image decomposition block 1508 maybe included in a server.

A negotiation and a re-negotiatiion between a transmission UE and areception UE which are to be described with reference to FIGS. 23 to 39may correspond to a session negotiation 1540 of FIG. 15 . Adjustment ofan output bitstream to be output to the reception UE according tooperation adjustment of each module of FIG. 15 , in response to thesession negotiation, may correspond to media adaptation 1530 of FIG. 15. In order to adjust an operation of each module, in response to thesession negotiation, a control block 1520 of FIG. 15 may transferinformation to each module. Hereinafter, FIGS. 16 to 19 illustrateoperation flowcharts of a transmission UE and a reception UE accordingto the present disclosure.

According to an embodiment of the present disclosure, a scenario may beconsidered, in which communication (e.g.: data transmission andreception, a voice call or, a video call, or the like) is performedbetween the transmission UE and the reception UE. In an embodiment, thetransmission UE may obtain a point cloud by photographing an object viaa camera. According to an embodiment, the object may refer to human or athing the camera can photograph. In an embodiment, the point cloud mayindicate a set of points that visibly configure a surface of the object.In an embodiment, the camera may be present separately from thetransmission UE or may be included in the transmission UE. In a casewhere the camera is present separately from the transmission UE, thecamera may be connected to the transmission UE in a wireless mannerusing an unlicensed spectrum, a sidelink, or Wi-Fi or in a wired mannerusing a USB-C cable. Then, the point cloud of the object photographed ormeasured by the camera may be transmitted to the transmission UE in awired or wireless manner.

According to an embodiment, the transmission UE may process (e.g.:compression) the point cloud, and may transmit the processed point cloudto the reception UE. The reception UE may display an AR image, based onthe processed point cloud received from the transmission UE. Here, thereception UE may display an object image generated based on the pointcloud, on an AR device (e.g.: AR glasses, AR display, or the like)included in the reception UE or an AR device existing separately fromthe reception UE. Here, the image may be a 2D image or a 3D image, andthe present disclosure is not limited thereto. In a case where an ARdevice exists separately from the reception UE, the AR device may beconnected to the reception UE in a wireless manner using an unlicensedspectrum, a sidelink, or Wi-Fi or in a wired manner using a USB-C cable.Then, the point cloud processed by the reception UE may be transmittedto the AR device in a wired or wireless manner. In the example above, avirtual reality (VR) device (e.g.: head mount display (HMD)) may beused, instead of the AR device.

The present disclosure relates to a procedure for negotiating, betweenthe transmission UE and the reception UE, information associated with apoint cloud so as to adaptively correspond to a situation such aschannel state degradation, while the transmission UE transmits the pointcloud to the reception UE or when the situation such as channel statedegradation occurs before transmission.

According to an embodiment of the present disclosure, for thenegotiation described above, the transmission UE may transmit a messageto the reception UE. In this regard, the message being transmitted fromthe transmission UE to the reception UE may be referred to as a sessiondescription protocol (SDP) offer message. The SDP offer message mayinclude a parameter for point cloud transmission and reception

According to an embodiment of the present disclosure, when the receptionUE receives the SDP offer message from the transmission UE, thereception UE may transmit a response message to the transmission UE.Here, the message being transmitted from the reception UE to thetransmission UE may be referred to as a SDP answer message. The SDPanswer message may include an application parameter of the reception UE.In an embodiment, the application parameter of the reception UE mayindicate a parameter that is applicable to the reception UE, from amongthe parameter for point cloud transmission and reception which aretransmitted by the transmission UE.

FIG. 16 illustrates a flowchart of an operating method of a transmissionUE according to an embodiment of the present disclosure.

Referring to FIG. 16 , in operation 1601, the transmission UE may obtaina point cloud by photographing an object. For example, the transmissionUE may photograph the object such as human or a thing via a camera thatis included in the transmission UE or exists separately from thetransmission UE. Then, the transmission UE may obtain information aboutthe point cloud of the object.

In operation 1603, the transmission UE may transmit, to the receptionUE, a message including a parameter for point cloud transmission andreception. According to an embodiment, the parameter for point cloudtransmission and reception may include a parameter associated with adirection of the object, a space parameter associated with the object,or the like. In an embodiment, the parameter associated with a directionof the object may indicate a display direction of the object in animage, when the object is displayed in the image by the reception UE.According to an embodiment, the direction of the object may indicate adirection of interest (DOI) of the reception UE. For example, the DOI ofthe reception UE may be determined according to an input by a user ofthe reception UE or a predetermined reference, and the reception UE maydisplay the object in the image, based on the DOI of the reception UE.In an embodiment, a space associated with the object may indicate aspace of the image in which the object is displayed, when the object isdisplayed in the image by the reception UE. For example, when the objectis human, an upper body of the human may be determined as the spaceassociated with the object, according to an input by the user of thereception UE or a predetermined reference. Accordingly, the spaceparameter associated with the object may include information indicatingan upper body region of the human.

In operation 1605, the transmission UE may receive, from the receptionUE, a response message including an application parameter of thereception UE. In an embodiment, the application parameter of thereception UE may be determined based on a channel state of the receptionUE and the parameter for point cloud transmission and reception.

In operation 1607, the transmission UE may compress the point cloud,based on the application parameter of the reception UE. For example, thetransmission UE may compress the point cloud so as to transmit the pointcloud to the reception UE, based on at least one parameter included inthe application parameter of the reception UE.

In operation 1609, the transmission UE may transmit the compressed pointcloud to the reception UE. In an embodiment, the transmission UE maytransmit the compressed point cloud to the reception UE via NR-U or aslidelink, based on the application parameter of the reception UE.

FIG. 17 illustrates a flowchart of an operating method of a reception UEaccording to an embodiment of the present disclosure.

Referring to FIG. 17 , in operation 1701, the reception UE may receive,from a transmission UE, a message including a parameter for point cloudtransmission and reception. According to an embodiment, a point cloudmay be obtained by photographing an object. The parameter for pointcloud transmission and reception may include at least one of a parameterassociated with a direction of the object or a space parameterassociated with the object.

In operation 1703, the reception UE may determine an applicationparameter of the reception UE, based on a channel state of the receptionUE and the parameter for point cloud transmission and reception. In anembodiment, the reception UE may identify an indicator indicatingwhether to use the parameter associated with the direction of the objector an indicator indicating whether to use the space parameter associatedwith the object. Then, the reception UE may determine the applicationparameter of the reception UE, based on the channel state of thereception UE, or the like.

In operation 1705, the reception UE may transmit, to the transmissionUE, a response message including the application parameter of thereception UE. For example, the reception UE may transmit the responsemessage to the transmission UE by including, in the response message,the application parameter of the reception UE being determined based onthe channel state of the reception UE and the parameter for point cloudtransmission and reception.

In operation 1707, the reception UE may receive, from the transmissionUE, a compressed point cloud. For example, the reception UE may receive,from the transmission UE, the point cloud compressed by the transmissionUE based on the application parameter of the reception UE.

In operation 1709, the reception UE may display an image associated withthe object, based on the compressed point cloud. For example, thereception UE may display the entirety or a part of the photographedobject, on a display being included in the reception UE or existingseparately from the reception UE. In an embodiment, the entirety or thepart of the photographed object may be displayed in an AR device.

According to an embodiment, the parameter for point cloud transmissionand reception may include resolution information of an image bufferassociated with compression of a point cloud, type information of theimage buffer, count information of the point cloud, transfer rateinformation of the point cloud, patch size information of the pointcloud, information indicating a priority between the count informationof the point cloud and the patch size information of the point cloud, orthe like.

According to an embodiment, the image buffer associated with compressionof the point cloud may indicate a 2D image generated by the point cloudpre-processor 1506 of FIG. 15 . Here, the generated 2D image mayindicate location information (i.e., geometry information) on a space,color information of point cloud (i.e. attribute information), orinformation indicating whether it is information for each pixel in a 2Dimage (e.g., occupancy map information), according to informationincluded in the 2D image among a plurality of pieces of information of a3D image. That is, the 2D image may be classified into types of thegeometry information, the attribute information, the occupancy mapinformation, or the like. The type information of the image buffer mayindicate the types of the geometry information, the attributeinformation, the occupancy map information, or the like. In anembodiment, a resolution of the image buffer may indicate a resolutionof a 2D image which corresponds to the image buffer.

In an embodiment, the count information of the point cloud may indicateinformation about the number of point clouds which can be transmittedfrom the transmission UE to the reception UE. The transfer rateinformation of the point cloud may indicate a transfer rate at which thetransmission UE can transmit a point cloud to the reception UE. In anembodiment, the transfer rate for the point cloud may be expressed as abitrate.

In an embodiment, the patch size information of the point cloud mayindicate information indicating a size of a patch generated with respectto the point cloud. In an embodiment, the information indicating apriority between the count information of the point cloud and the patchsize information of the point cloud may indicate information indicatinga priority order of parameters during transmission and reception of thepoint cloud. For example, when the count information of the point cloudhas a higher priority than the patch size information of the pointcloud, and the number of point clouds corresponds to a particularcondition for transmission and reception of the point cloud, the patchsize information of the point cloud may be ignored.

In an embodiment, the reception UE may determine the applicationparameter of the reception UE which is applicable to the reception UE,from a plurality of pieces of information included in the parameter forpoint cloud transmission and reception, based on the channel state ofthe reception UE or a predetermined reference. Then, the reception UEmay transmit the application parameter of the reception UE to thetransmission UE, and the transmission UE may transmit an optimal pointcloud to the reception UE.

Hereinafter, FIGS. 18 and 19 illustrate embodiments in which a receptionUE determines an application parameter of the reception UE.

FIG. 18 illustrates a flowchart of a method of determining anapplication parameter of the reception UE according to an embodiment ofthe present disclosure.

Referring to FIG. 18 , in operation 1801, the reception UE may identify,from a parameter for point cloud transmission and reception, anindicator indicating whether to use a parameter associated with adirection of an object. In an embodiment, the parameter for point cloudtransmission and reception may include the indicator indicating whetherto use the parameter associated with the direction of the object. Forexample, the indicator may indicate usage or non-usage of the parameterassociated with the direction of the object. Alternatively, when theindicator is included in the parameter for point cloud transmission andreception, the reception UE may identify that the parameter associatedwith the direction of the object is to be used. Alternatively, when theindicator is not included in the parameter for point cloud transmissionand reception, the reception UE may identify that the parameterassociated with the direction of the object is not to be used. In anembodiment, the indicator that indicates whether to use the parameterassociated with the direction of the object may be referred to asdoi_enabled.

In operation 1803, the reception UE may determine at least one amongdisplay directions of the object, based on a channel state of thereception UE or a predetermined reference. For example, in operation1801, when usage of the parameter associated with the direction of theobject is determined based on the indicator indicating whether to usethe parameter associated with the direction of the object, the receptionUE may determine at least one among the display directions of theobject, based on the channel state of the reception UE or thepredetermined reference. Here, information about the display directionsof the object may be included in the parameter for point cloudtransmission and reception.

In an embodiment, the channel state of the reception UE may includeinformation associated with a state, a bandwidth, and a pathloss of anetwork including the reception UE or congestion of the networkincluding the reception UE. Also, the predetermined reference that isused to determine at least one among the display directions of theobject may indicate information indicating performance of the receptionUE capable of processing the point cloud. According to an embodiment,while it is expressed as the predetermined reference, the presentdisclosure is not limited thereto and may determine or update acorresponding reference when the reception UE requires it. As describedabove with reference to description of FIG. 19 , the reception UE maydetermine at least one of a plurality of pieces of informationindicating one or more regions associated with the object, and mayinclude and transmit the determined information in a response message tothe transmission UE.

FIG. 19 illustrates a flowchart of a method of determining anapplication parameter of a reception UE according to an embodiment ofthe present disclosure.

Referring to FIG. 19 , in operation 1901, the reception UE may identify,from a parameter for point cloud transmission and reception, anindicator indicating whether to use a space parameter associated with anobject. In an embodiment, the parameter for point cloud transmission andreception may include the indicator indicating whether to use the spaceparameter associated with the object. For example, the indicator mayindicate usage or non-usage of the space parameter associated with theobject. Alternatively, when the indicator is included in the parameterfor point cloud transmission and reception, the reception UE mayidentify that the space parameter associated with the object is to beused. Also, when the indicator is not included in the parameter forpoint cloud transmission and reception, the reception UE may identifythat the space parameter associated with the object is not to be used.In an embodiment, the indicator indicating whether to use the spaceparameter associated with the object may be referred to as space ofinterest (soi)_enabled, and details about soi_enabled will be providedbelow.

According to an embodiment, the space parameter associated with theobject may include at least one of information indicating a scheme ofsegmenting the object into one or more regions or information indicatingthe one or more regions associated with the object. For example, theinformation indicating the scheme of segmenting the object into one ormore regions may indicate information indicating a scheme of segmentinga human-shape object into a head region, a neck region, a shoulderregion, an elbow region, or the like. Also, for example, the informationindicating one or more regions associated with the object may indicateinformation indicating the head region as a value of 0, the neck regionas a value of 1, the shoulder region as a value of 2, the elbow regionas a value of 3, or the like, based on the information indicating thescheme of segmenting the object into one or more regions. Alternatively,the information indicating one or more regions associated with theobject may include information indicating coordinates of a region of theobject on a space.

In operation 1903, the reception UE may determine at least one among aplurality of piece of information indicating one or more regionsassociated with the object, based on a channel state of the reception UEor a predetermined reference. For example, in operation 1901, when usageof the space parameter associated with the object is identified based onthe indicator indicating whether to use the space parameter associatedwith the object, the reception UE may determine at least one of theinformation indicating one or more regions associated with the object,based on the channel state of the reception UE or the predeterminedreference. Here, the information indicating one or more regionsassociated with the object may be included in the parameter for pointcloud transmission and reception.

FIG. 20A illustrates an example in which a point cloud is illustrated ina 3D space. That is, FIG. 20A illustrates the point cloud of human shownin FIG. 9 in different directions.

Referring to FIG. 20A, the original of the point cloud shown in FIG. 20Aconsists of 775,745 points. However, the point cloud in the left picture(a) of FIG. 20A consists of 155,149 points that are about ⅕ of theoriginal, and the point cloud in the right picture (b) of FIG. 20Aconsists of 77,575 points that are about ⅒ of the original. Unlike a 2Dstill image or a moving picture, a point cloud may allow an object orhuman to be seen in every direction. As shown in FIG. 15 , as the numberof points is decreased, an image quality may be degraded. That is, animage quality of the right picture (b) consisting of smaller points thanthe left picture (a) may be further degraded.

FIG. 20B illustrates an example in which a part of a point cloud istransmitted. FIG. 20C illustrates an example in which a part of a pointcloud is transmitted according to an embodiment of the presentdisclosure.

Referring to FIGS. 20B and 20C, a reason why it is requested to specify3D spaces for partial transmissions of a 3D image by a point cloudpre-processor is shown. As shown in FIG. 20B, when a point cloud istransmitted by being segmented by ⅓ without understanding of anarrangement of content on a space, there may occur a problem in which apart of an object is not appropriately segmented.

However, as shown in FIG. 20C, when a reception UE specifies andrequests a desired 3D space from a transmission UE, the transmission UEmay segment the object into spaces such as an upper body, a torso, alower body, or the like having contexts. Then, the transmission UE maytransmit, to the reception UE, point clouds of the segmented spaces. Asdescribed above, in order for the reception UE to request the desired 3Dspace from the transmission UE, it may be preferable for thetransmission UE to provide information about spaces being selectable bythe reception UE.

In an embodiment, spaces into which an object can be segmented mayoverlap with each other, and may be provided independently from otherspace, according to locations of parts of the object and usage purposeof the reception UE. The reception UE may select one or more desiredspaces, based on the information about spaces received from thetransmission UE. Then, the reception UE may transmit information aboutselected spaces to the transmission UE, thereby receiving a 3D imageformed of selected spaces.

FIG. 21 illustrates an example of a transmission message of atransmission UE which is generated based on a space parameter accordingto an embodiment of the present disclosure.

In more detail, FIG. 21 illustrates space information and an annotationprovided by the transmission UE. A reception UE may instruct spaceinformation of a 3D image which is requested for the transmission UE totransmit when a network situation is not available, according to areference including the annotation, a relation to a direction in which auser of the reception UE has a view within a space, a default behaviorof a video call application running in the reception UE, or a preferencepredetermined by the user.

According to an embodiment, the transmission UE supporting provision andselection of a space may include an indicator such as soi_enabled in aSDP offer message. When the transmission UE provides an annotation abouta space, the transmission UE may include, in the SDP offer message,annotation=yes and annotation-schema. Then, the transmission UE mayrepeat, by the number of spaces, one or more annotation numbers[x1,y1,z1,x2,y2,z2:annotation_id1, annotation_id2, ...] associated withtwo vertexes [x1,y1,z1,x2,y2,z2] to indicate a space, and may includesuch generated numbers in the SDP offer message.

The reception UE according to an embodiment of the present disclosuremay include an application to provide a video call function based on a3D image transmitted by the transmission UE. In re-negotiation betweenthe transmission UE and the reception UE due to a network situation, thereception UE may receive the SDP offer message provided by thetransmission UE. When the SDP offer message includes soi_enabled, thereception UE may identify that the entirety or only a part of a spaceassociated with an object is to be received from the transmission UE.

In an embodiment, when the reception UE identifies one or more spaceswith respect to the object, not an entire part of the object, thereception UE may give a priority order to spaces, according to variousevaluation references, and thus, may determine spaces to be requested tothe transmission UE. For example, the evaluation references may includea first reference by which a space including an upper body or a bodypart of the upper body (e.g.: both shoulders of a torso, a neck and ahead of the torso, or the like) for determination of a facialexpression, a face, a gesture, or the like of a speaker, according to acharacteristic of a 3D video call service, has a priority. Also, theevaluation references may include a second reference by which a varianceaccording to accumulated movement of the speaker in a space has apriority. The evaluation references may include a third reference bywhich a preference pre-selected by a user of the reception UE isfollowed, a fourth reference by which statistics of a change history ofdifferent selections is followed, or a fifth reference by which aheuristic algorithm such as artificial intelligence (AI) is followed.

In an embodiment of the present disclosure, a video call may beconsidered as a reference of selecting a space. When a space is selectedaccording to a network situation in a usage example where thetransmission UE and the reception UE perform transmission of a 3D image,embodiments of the present disclosure may be applied to any case wherean operation of the reception UE is determined based on a reference of aservice feature and statistics on designation or usage by the user ofthe reception UE.

According to an embodiment, the reception UE may select, by complexlyusing the references, a space to be received with a priority accordingto a network situation. Then, the reception UE may transmit theselection of the space to the transmission UE via a message as in FIG.33B. The transmission UE may transmit, to the reception UE, a 3D imagecorresponding to only the space selected by the reception UE.

FIGS. 22 to 24 to be described below illustrate an example of a sessiondescription protocol (SDP) for negotiating a point cloud transmissionand reception scheme between a transmission UE and a reception UE. FIGS.27, 28, and 29 illustrate a format of an instruction for dynamicallychanging the point cloud transmission and reception scheme between UEsaccording to a change in a network load or channel state, the pointcloud transmission and reception scheme being determined by usingprocedures of FIGS. 22 to 24 .

FIG. 22 illustrates an example of a transmission message of atransmission UE according to an embodiment of the present disclosure.

FIG. 22 illustrates a SDP offer message a UE capable of transmitting orreceiving a point cloud transmits to the other UE via an IMS. That is,FIG. 22 illustrates a SDP offer message that is transmittable from atransmission UE to a reception UE. The SDP offer message may be includedin a session initiation protocol (SIP) and may be transmitted to theother UE via multiple nodes of the IMS. The UE may propose, via the SDPoffer message of FIG. 22 , the other UE to bidirectionally (a=sendrecv)transmit and receive a frame by compressing the frame with the H.265video codec, the frame including multiple patches shown in FIG. 11 .Hereinafter, with reference to FIG. 22 , the UE may refer to atransmission UE and the other UE may refer to a reception UE.

In the SDP offer message of FIG. 22 , a=imageattr:99 send[x=1920,y=1080] [x=1280,y=720] recv [x=1920,y=1080] [x=1280,y=720] type[one] [gao] [gao2] may propose that, when the patches of FIG. 11 arecollected on a plane and are compressed as a video image, the other UEis to select 1920x1080 or 1280x720 as a maximum resolution of an imagebuffer, i.e, a plane to be bidirectionally used by a video codec. Here,the image buffer may indicate a 2D image generated from the point cloudpre-processor 1506 of FIG. 15 . Here, the generated 2D image may bethree types of a location (i.e., geometry) on a space, color of pointcloud (i.e., attribute), or information indicating whether it isinformation for each pixel in the 2D image (e.g., occupancy map),according to information included in the 2D image among a plurality ofpieces of information of a 3D image. After a resolution of the imagebuffer is designated, a type of the image buffer may be displayed via“type”. That is, when “type” is [one], it may mean that all types of 2Dimages are stored in one image buffer.

If 2D images are storage in separate image buffers according to types ofthe 2D images, g (Geometry), a (Attribute), o (Occupancy), and thenumber of layers for each type may be sequentially displayed for eachimage buffer type. For example, gg may indicate that a geometry imagebuffer has two layers. Also, when one or more image buffer types havedifferent resolutions, a number such as 2 may be added to the end (e.g.:o2). Here, a resolution of an image buffer of a corresponding type mayindicate a value obtained by dividing a width and height of a resolutiondefined in imageattr by a number (e.g.: when a resolution of imageattris x=1920, y=1080, and type is o2, a resolution of an occupancy map is960x540). That is, a number (e.g.: 2 of o2) that is addible to the endof the letter indicating a type of an image buffer may indicate a valueused to divide a width and a height of a resolution of the image buffer.

According to an embodiment, in the SDP offer message of FIG. 22 ,a=pointcloud:99 ply; vpcc; ply xyz:10 rgb1:8 rgb2:8; profile-id=Basic;rec-level: 0; level-id=1; max_vertex 100000; max_vertex_per_second10000000; max_patch_length_x=500; max_patch_length_y=500 may proposethat maximum 100000 points of a point cloud with PLY format are to betransmitted by using a bitrate equal to or less than 10 Mbps(b=AS:10000). In the SDP offer message of FIG. 22 , profile-id andrec-level and level-id may respectively indicate a type (e.g.: basic orextended) of a profile used in point cloud compression, a level (e.g.:0, 1 or 2) for 3D image reconstruction, and a parameter for representinga quality (e.g.: 1: about 1 million per frame, 2: about 2 millions) ofthe compressed point cloud.

According to an embodiment, in the SDP offer message of FIG. 22 ,max_vertex may indicate a maximum number of points per frame of a pointcloud media. max_vertex_per_second may indicate a total sum of pointsincluded in frames being transmitted per second. For max_vertex ormax_vertex_per_second described above, an appropriate value may bedesignated according to processing capability of a generating entity ofthe transmission UE or a rendering entity of the reception UE.

According to an embodiment, in the SDP offer message of FIG. 22 , 99 mayindicate a payload type number allocated to this session including thepoint cloud media. Then, ply xyz:10 rgb1:8 rgb2:8 may indicate that adata array with PLY format is X, Y, Z coordinates represented with 10bits and two R, G, B color components each represented with 8 bits. Thatis, when one or more color components are applicable to one XYZlocation, existence of n rgb attributes may be represented in a mannerof ply xyz:10 rgb1:8 rgb2:8 ... rgbn:8. max_patch_length_x=500 andmax_patch_length_y=500 may indicate maximum horizontal and verticallengths of each patch and may indicate that the maximum horizontal andvertical lengths of each patch is 500 points.

According to an embodiment, if only one of two different conditionsincluded in a SDP offer message is satisfied, e.g., if a transferbitrate with respect to a point cloud is not greater than 10 Mbps but120000 points are used, or on the contrary, if 100000 points are usedbut a transfer bitrate with respect to a point cloud is greater than 15Mbps, it may be configured such that all the conditions described aboveare not to be exceeded. That is, it may be configured such that atransfer bitrate with respect to a point cloud is not to be greater than10 Mbps and points not greater than 100000 are to be used.

However, when the transmission UE or the reception UE attempts totransmit or receive a point cloud media consisting of 100000 points ormore while maximally using a given bandwidth, e.g., a bandwidth of 10Mbps, one prioritized condition that ignores other conditions may bedesignated. An example of the prioritized condition is provided withreference to FIG. 23 .

FIG. 23 illustrates an example of a transmission message of atransmission UE according to an embodiment of the present disclosure.

FIG. 23 proposes a method by which a prioritized parameter such asprioritized AS vertex patch is selectively specified and transferred viaa SDP offer message. A plurality of different prioritized parameters maybe designated in ascending priority order. For example, the example ofFIG. 23 illustrates that the number of vertexes (i.e., the number ofpoint clouds) may be ignored when a bitrate meets a condition, or alimit in a patch size may be ignored when a bitrate and the number ofvertexes meet a condition. However, in an embodiment, all conditionsthat are not specified as prioritized parameters may not be changed orexceeded. That is, with respect to a condition such as codec or profilewhich is not specified as a prioritized parameter, the transmission UEmay operate according to a SDP protocol. That is, a point cloud to betransmitted or received may be determined based on parameters providedvia a SDP offer message.

Referring to FIGS. 27, 28, 29, 30 a, 30 b, 31, 32 a, 32 b, 33 a, 33 b,and 34 , one message or a plurality of messages may be transmitted to atransmission UE or a reception UE, and accordingly, a point cloud of anobject may be generated as in FIG. 15 so as to meet one or moreconditions.

According to an embodiment, doi_enabled specified in a SDP Offer messagemay indicate a flag by which the transmission UE indicates a support ofa point cloud processing / encoding function using DOI information ofthe reception UE. According to an embodiment, that the flag is notincluded in the SDP offer message may mean that the transmission UE anda session between the transmission UE and the reception UE do notsupport the point cloud processing / encoding function using the DOIinformation of the reception UE.

According to an embodiment, the transmission UE may provide a separatelabeling function with respect to a part of a 3D image by usingadditional processing such as AI. For example, the transmission UE mayprovide the reception UE with an annotation that is combined with a DOIand is about a part of a 3D image which is indicated by the DOI, asshown in FIGS. 32A and 32B. For example, when a schema is indicated withreference to FIG. 22 , the transmission UE may display an annotationaccording to the indication. Alternatively, when only existence ornon-existence of an annotation is displayed without a schema, thetransmission UE may describe a DOI in the form of descriptive text.

FIG. 24 illustrates an example of a response message to a transmissionmessage of a transmission UE according to an embodiment of the presentdisclosure.

According to an embodiment, a reception UE receives the SDP offermessage of FIG. 22 or FIG. 23 , and FIG. 24 illustrates a SDP Answermessage in which a quality of service (QoS) parameter is modified to beapplicable to a session and that is transmitted back. With the SDPanswer message, the reception UE may specify that the reception UEreceives a point cloud compressed with H.265 codec but does not transmitit to the other UE (a=recvonly). The reception UE may include, in theSDP answer message, information indicating that the reception UE uses aresolution of 1280×720 as an image buffer resolution and uses a bitrateequal to or less than 6 Mbps. For example, all patches of each framewith a maximum size of 500×500 may be included within a maximumresolution of 1280×720 agreed between the transmission UE and thereception UE. In an embodiment, when doi_enabled flag is included in theSDP Answer message, it may mean that the reception UE requests thetransmission UE for Direction of Interest based delivery session. Here,direction of interest metadata RTCP channel as in FIG. 30A may be usedfor the request.

FIG. 25 illustrates a procedure of negotiation between a transmission UEand a reception UE for transmission of a point cloud according to anembodiment of the present disclosure. For example, FIG. 25 illustrates aprocedure in which a transmission UE (UE A) 2510 and a reception UE (UEB) 2520 negotiate a transmission scheme for a point cloud by using theIMS shown in FIG. 14 , and ensure a QoS of a wired or wirelesstransmission path.

Referring to FIG. 25 , in an embodiment, the transmission UE 2510 mayinclude a first SDP offer message 2502 in an SIP INVITE message 2501 andmay transmit the message the to a proxy call session control function(P-CSCF) that is an IMS node allocated to it. The message may betransferred via nodes such as a session call session control function(S-CSCF), an interrogating call session control function (I-CSCF), etc.to an IMS to which the other UE is connected and may be finallytransferred to the reception UE 2520. In an embodiment, the first SDPoffer message 2502 may include an SDP offer shown in FIGS. 21 to 23 .

In an embodiment, the reception UE 2520 may select an available bitrateand transmission scheme among bitrates and point cloud transmissionschemes proposed by the transmission UE 2510. Then, the reception UE2520 may include a first SDP answer message 2504 including the selectedinformation in an SIP 183 message 2503 and may transmit the message tothe transmission UE 2510. In a procedure where the SIP 183 message 2503including the first SDP answer message 2504 is transferred to thetransmission UE, each of IMS nodes may start reserving transmissionresources of wired/wireless network requested for the service. Then, allconditions of a session including point cloud transmission may be agreedbetween the transmission UE 2510 and the reception UE 2520 via exchangeof additional messages including a PRACK message 2505, an SIP 200message 2507, an SIP UPDATE message 2509 and an SIP 200 message 2511.For example, the transmission UE 2510 may generate and transmit a secondSDP offer message 2506 in response to a state change from a state (e.g.:a network state) of the transmission UE 2510 at a transmission time ofthe first SDP offer message 2502, or as a default regardless of thestate change. In response thereto, the reception UE 2520 may generateand transmit a second SDP answer message 2508.

According to an embodiment, when the transmission UE identifiestransmission resources of all transmission durations, the transmissionUE may transmit a point cloud to the reception UE via a Media Flowmessage 2513. However, it is not always requested for the point cloud tobe transmitted via the Media Flow message 2513, and the point cloud maybe transmitted from the transmission UE to the reception UE, regardlessof a message format. FIG. 26 to be described below illustrates aprocedure in which the reception UE 2520 generates the SDP answermessage based on the SDP offer message transmitted by the transmissionUE 2510.

FIG. 26 is a flowchart of a response message generation procedure in thereception UE according to an embodiment of the present disclosure. Inmore detail, FIG. 26 illustrates a procedure in which the transmissionUE analyzes the SDP offer message transmitted by the transmission UE andthen generates and transmits the SDP answer message in FIG. 25 .

Referring to FIG. 26 , in operation 2601, the reception UE may receivean SDP offer message. That is, the reception UE may receive, from thetransmission UE, a message including a parameter for point cloudtransmission and reception.

In operation 2603, the reception UE may determine whether it is possibleto accept b=AS. That is, the reception UE may compare b=AS value in thereceived SDP offer message with a maximum bitrate value available forthe reception UE, thereby determining whether it is an acceptable value.For example, when it is not acceptable value, the reception UE maydecrease b=AS value in operation 2605. That is, when a bitrate is notacceptable, the reception UE may decrease the bitrate to be equal to orless than the maximum bitrate value acceptable for the reception UE.

In operation 2607, the reception UE may select a resolution froma=imageattr. For example, after the reception UE determines whether thebitrate is within an acceptable range in operation 2603, the receptionUE may determine a resolution appropriate for the reception UE.

In operation 2609, the reception UE may determine whether it is possibleto accept max_vertex. For example, the reception UE may determinewhether the number of points (max_vertex) in the SDP offer message isappropriate for a bitrate and a resolution which are determined inprevious operation (e,g.: operation 2603 to operation 2607). Whenmax_vertex included in the SDP offer message is not acceptable, thereception UE may decrease max_vertex in operation 2611. That is, thereception UE may decrease max_vertex included in the SDP offer messageto be within a range for the reception UE can accept.

In operation 2613, the reception UE may determine whether it is possibleto accept max_patch_length(x,y). That is, the reception UE may determinewhether it is possible to accept a maximum patch length that ismax_patch_length(x,y) value in the received SDP offer message. When itis not acceptable, the reception UE may decrease max_patch_length(x,y)in operation 2615. That is, when the maximum patch length is notacceptable, the reception UE may decrease the maximum patch length to bewithin a range for the reception UE can accept.

In operation 2617, the reception UE may check whether doi_enabledexists. For example, the reception UE may identify that doi_enabled thatis an indicator indicating whether DOI information of the reception UEis usable is included in the SDP offer message received from thetransmission UE. In an embodiment, when doi_enabled is not included inthe SDP offer message, the reception UE may generate an SDP answermessage in operation 2621, based on the bitrate, the resolution, thenumber of points of a point cloud, a maximum number of patches, etc.which are described in operations 2603 to 2613.

In operation 2619, the reception UE may determine DOI, based on adelivery usage. That is, after the reception UE identifies that theindicator of doi_enabled is included in the SDP offer message, thereception UE may determine the DOI, based on the delivery usageindicating a usage example such as a video call.

In operation 2621, the reception UE may generate the SDP answer message,based on the bitrate, the resolution, the number of points of a pointcloud, the maximum number of patches, the DOI, etc. which are describedin operations 2603 to 2619.

In operation 2623, the reception UE may transmit the SDP answer message.That is, the reception UE may transmit, to the transmission UE, the SDPanswer message generated in operation 2621. In an embodiment, thereception UE may include the SDP answer message in the SIP 183 messageand may transmit the message to the transmission UE.

According to an embodiment, after a session condition is determinedbased on the procedure of FIG. 26 , the transmission UE may transmit, tothe reception UE, a point cloud compressed based on the sessioncondition. However, at this time, a situation where a scheduled bitratecannot be maintained due to deterioration in a channel state may occur.In this case, the transmission UE may transmit, to the transmission UE,a TMMBR message as shown in FIG. 6 , thereby requesting to temporarilydecrease the bitrate. In an embodiment, when the reception UE transmitsthe TMMBR message, the reception UE transmits the TMMBR message togetherwith a message shown in FIG. 27 , thereby requesting to decrease amaximum number of point clouds per frame.

FIG. 27 illustrates an example of metadata transmitted from thereception UE to the transmission UE according to an embodiment of thepresent disclosure. A field of Number of Points in the message shown inFIG. 27 may indicate a parameter of max_vertex of an SDP message. Thefield of Number of Points may indicate the number of points between 0and 2³¹-1, That is, Maximum Number of Points of FIG. 27 may indicate amaximum number of points which can constitute a point cloud.

According to an embodiment, a maximum or minimum proportion of a surfaceof human or object which can be represented as a point cloud may beadjusted with adjustment of a bitrate. For example, FIGS. 28 and 29 tobe described below illustrate examples of a message transmitted foradjustment of a maximum or minimum proportion of a surface of an objectwhich can be represented as a point cloud.

That is, FIG. 28 illustrates an example of metadata transmitted from thereception UE to the transmission UE according to an embodiment of thepresent disclosure. FIG. 29 illustrates an example of metadatatransmitted from the reception UE to the transmission UE according to anembodiment of the present disclosure.

A field of Maximum Proportion of Represented Surface in the messageshown in FIG. 28 and a field of Minimum Proportion of RepresentedSurface in the message shown in FIG. 29 may be represented with a valueindicating a proportion of 0 to 100% in a unit of 1%. For example, whenit is not possible to transmit 100% of a surface, the transmission UEmay select a point cloud of a region which is determined, by thetransmission UE, to be important for the reception UE and may transmitthe point cloud. When the channel state is improved thereafter, thereception UE may transmit the TMMBR message and the messages of FIGS. 27and 28 to the transmission UE, and thus, may gradually a bitrate and thenumber of points, a proportion of the surface, and the like, therebyallowing the bitrate, the number of points, the proportion of thesurface, and the like to have their negotiated original values before aservice starts.

According to an embodiment, even when a bitrate and the number of pointswhich are currently used are appropriate, it may be necessary for thereception UE to request the transmission UE to process and transmitpoints in an important direction with priority. For example, as anecessity of points displaying the back of a person who is addressing ortalking may be low, the reception UE may transmit a DOI informationmessage as shown in FIG. 30A so as to notify the transmission UE of animportant direction.

FIG. 30A illustrates an example of metadata transmitted from thereception UE to the transmission UE according to an embodiment of thepresent disclosure.

Via a message shown in FIG. 30A, a random DOI of the reception UE whichis in a 3D space as shown in FIG. 20A may be indicated. For example, inFIG. 30A, fields of X, Y, Z may indicate a start point of a vectorindicating a DOI and fields of TX, TY, TZ may indicate an end point ofthe vector indicating the DOI. According to an embodiment the fields ofX, Y, Z, TX, TY, TZ may be indicated with real numbers each having arange between 0 and 1. Then, the reception UE may synchronize anoriginal point of the object represented as the point cloud with anoriginal point of the vector of the DOI, may synchronize X, Y, and Zaxes, and then may convert coordinates to be synchronized withcoordinates of the vector of the DOI, wherein the coordinates areobtained by normalizing, as 0 to 1, coordinates of the objectrepresented as the point cloud. For example, when it is assumed that astart point of a vector of a DOI with respect to a point cloud objectwith a size of X axis of 0 to 500, Y axis of 0 to 1000, and Z axis of 0to 3000 is (1, 0.5, 0.5) and an end point thereof is (0, 0.5, 0.5), thestart point and the end point of the vector of the DOI with respect tothe point cloud object may correspond to (500, 500, 1500) and (0,500,1500). This may indicate that the DOI is set facing forward in theX-axis direction at the center of YZ plane.

According to an embodiment, in FIG. 30B, the same message format as FIG.30A is used but a different subtype is indicated, such that a region ofSOI in the 3D space as shown in FIG. 30A may be indicated. That is, thefields of X, Y, Z in FIG. 30B may indicate a start point of a hexahedronrepresenting the region of SOI, and the fields of TX, TY, TZ mayindicate an end point of the hexahedron representing the region of SOI,such that a size and a location of the hexahedron may be indicated.Here, in order to represent a rotation of the SOI, W parameter may beused. That is, the reception UE may rotate the vector connecting thestart point (XYZ) to the end point (TXTYTZ) in a clockwise direction bya value of W angle by using the W parameter, and may display a resultthereof as the region of SOI. The reception UE may transmit, to thetransmission UE, the region of SOI determined as described above. Then,the transmission UE may transmit a point cloud corresponding to only theindicated region of SOI as in FIG. 20C.

A scheme of displaying a region of interest (ROI) described withreference to FIGS. 30A and 30B is similar to a viewport of VR in that itis an ROI a view has interest, however, the VR indicates, to a viewport,a direction in which the viewer watches with equipment such as HMDwhereas, in the present disclosure, a direction in which the viewerwatches may be different from a DOI. That is, in a scenario such as anAR video call, when a 3D image of the other person is displayed on thefront side of the viewer, although a viewport with respect to the 3Dimage of the other person faces forward, the profile or the back of theother person may be indicated as a DOI via a separate user interface(UX), and a UE of the other person (i.e., a transmission UE) maytransmit only the indicated part. Alternatively, when multiple virtualparticipants are seated as in a virtual meeting, the profiles of theparticipants are seen (viewports are the profiles) at a location of theviewer, but the viewer indicates only the front sides of theparticipants as a DOI so as to allow parts corresponding to only thefront sides to be transmitted.

FIG. 31 illustrates a flowchart of a procedure in which the transmissionUE transmits point cloud media, based on a message received from thereception UE, according to an embodiment of the present disclosure. Thatis, FIG. 31 illustrates an embodiment that is occurrable when thetransmission UE receives multiple messages about point cloud media fromthe reception UE via RTCP APP packets as a situation of a communicationnetwork changes after a session is set up between the transmission UEand the reception UE.

Referring to FIG. 31 , in operation 3101, the transmission UE mayreceive TMMBR feedback from the reception UE. Then, the transmission UEmay receive, via the TMMBR feedback, a bitrate requested by thereception UE.

In operation 3103, the transmission UE may receive feedback on a maximumnumber of points. In operation 3105, the transmission UE may checkwhether DOI is enabled. If the DOI is not enabled, the transmission UEmay adjust the number of point clouds in operation 3113. That is, thetransmission UE may adjust the number of points included in a pointcloud. When the DOI is enabled, in operation 3107, the transmission UEmay adjust a direction of the point cloud. That is, when the DOI isenabled, the transmission UE may adjust the direction of the pointcloud, based on DOI information received from the reception UE.

In operation 3109, the transmission UE may receive feedback on a maximumor minimum proportion of a surface of an object. That is, thetransmission UE may receive, from the reception UE, information about amaximum proportion or a minimum proportion as shown in FIGS. 28 and 29 .In operation 3111, the transmission UE may adjust a surface of a pointcloud. For example, the transmission UE may adjust a surface proportionof the point cloud, based on the received maximum or minimum proportionof the surface of the object.

In operation 3113, the transmission UE may adjust the number of pointclouds. That is, the transmission UE may adjust the number of pointsincluded in a point cloud. In operation 3115, the transmission UE mayperform point cloud encoding. In operation 3117, the transmission UE maydetermine whether a media bitrate satisfies TMMBR That is, thetransmission UE may determine whether the media bitrate satisfies thebitrate received via the TMMBR message. If not satisfied, thetransmission UE may perform again operation 3113. For example, thetransmission UE may set the bitrate received in operation 3101 as atarget amount of transmission, may perform an adjustment process tocorrespond to the set target amount of transmission, and thus, mayadjust the number of points to be included in the point cloud. Inoperation 3119, the transmission UE may transmit media. That is, thetransmission UE may transmit, to the reception UE, the point cloudprocessed via operations 3101 to 3117 described above.

According to an embodiment, the reception UE may select and indicate,among parameters included in an SDP offer message, characteristics forparticularly defining a transmission quality. Metadata to request thecharacteristics may be represented as shown in FIGS. 27 to 30B.

FIG. 32A illustrates an example in which the transmission UE provides anannotation to the reception UE according to an embodiment of the presentdisclosure.

For example, FIG. 32A illustrates a method by which the transmission UEprovides the reception UE with the annotation about a region indicatedby DOI when annotation provision is indicated. According to anembodiment, with respect to a designated direction, an annotation may beprovided as a length of descriptive text (e.g.: descriptive text) oractual text (e.g.: Annotation value).

FIG. 32B illustrates an example in which the transmission UE provides anannotation to the reception UE according to an embodiment of the presentdisclosure.

For example, FIG. 32 illustrates a case in which an annotation isprovided with annotation schema. For example, when an upper body of anobject is indicated, 0, 1, 2, 3, 4, 5, 6, 7, 14 may be indicated inannotation_value. Alternatively, when only a face (head) is indicated asDOI, 0 may be indicated in annotation_value.

FIG. 33A illustrates an example in which the reception UE provides thetransmission UE with a response corresponding to an annotation accordingto an embodiment of the present disclosure.

For example, FIG. 33A illustrates a method by which the reception UErequests the transmission UE for only a part of a 3D image whichcorresponds to a particular annotation.

FIG. 33B illustrates an example in which the reception UE provides thetransmission UE with a response corresponding to an annotation accordingto an embodiment of the present disclosure. FIG. 33B illustrates amethod by which the reception UE requests the transmission UE for only apart of a 3D image which corresponds to a particular annotation.However, unlike FIG. 33B, FIG. 33A illustrates an embodiment in whichthe reception UE indicates only an annotation without indication of aninterest type. Unlike FIG. 33A, in FIG. 33B, the reception UE may notifythe transmission UE of an interest type along with an annotation value.In FIG. 33B, Interest_type may be used as 0:none, 1:direction, 2:space,3:reserved, and Annotation values may be used to indicate a plurality ofregions or directions of interest, as 0,1,2.

FIG. 34 illustrates an example of a method of indicating, via anannotation, a body part of human in a 3D image according to anembodiment of the present disclosure.

Referring to FIG. 34 , an example of schema of indicating body parts ofhuman in the 3D image is illustrated. For example, representative partsmay be segmented with respects to joints of a human body and thus may beidentified, and it is possible for the transmission UE and the receptionUE to indicate a DOI or an SOI by designating a human text and a value.

FIG. 35 illustrates an example of a PLY format of a point cloudaccording to an embodiment of the present disclosure.

For example, FIG. 35 illustrates a part of a PLY format of a point cloudas illustrated in FIG. 20A. In FIG. 35 , various types of additionalinformation may be described, starting from ply that is the format up toend_header. Numbers thereafter may indicate RGB values and XYZcoordinates of each point. The coordinates may be the same ascoordinates used with reference to FIG. 20A, and each coordinate may beequal to 0 or greater than 0. X, Y, Z, TX, TY, TZ of the message of FIG.32B may correspond to the coordinates. However, when a bit of a field of+/- is set to 0, it may indicate an opposite direction.

According to the aforementioned embodiment of the present disclosure,according to a scheme of dynamically adjusting representations of apoint cloud session between the transmission UE and the reception UE anda service condition negotiation procedure using an IMS, the number ofpoints during the session, a surface proportion of an object or humanrepresented as a point cloud, and a DOI, a method of compressing andtransmitting a point cloud may be efficiently adjusted according to achange in a channel state with respect to the transmission UE or thereception UE. Via the efficient adjustment, a network capacity and mediaquality may be maximized.

FIG. 36 illustrates a block diagram of a configuration of a transmissionUE or a reception UE according to an embodiment of the presentdisclosure. Hereinafter, in FIG. 36 , a UE may indicate the transmissionUE or the reception UE.

As illustrated in FIG. 36 , the UE of the present disclosure may includea processor 3630, a transceiver 3610, a memory 3620, and a camera 3640,However, elements of the UE are not limited to the example above. Forexample, the UE may include more elements than the elements describedabove or may include fewer elements than the elements described above.

For example, the transmission UE may further include a camera forobtaining a point cloud, and the reception UE may further include adisplay for displaying a received point cloud. Furthermore, theprocessor 3630, the transceiver 3610, and the memory 3620 may beimplemented as one chip.

According to an embodiment, the processor 3630 may control a series ofprocesses to allow the UE to operate according to the aforementionedembodiments of the present disclosure For example, the elements of theUE may be controlled to perform a method of controlling negotiation ofparameters associated with a point cloud session between thetransmission UE and the reception UE according to an embodiment of thepresent disclosure. The processor 3630 may be provided in a multiplenumber, and may perform, by executing a program stored in the memory3620, the method of controlling negotiation of parameters associatedwith a point cloud session between the transmission UE and the receptionUE of the present disclosure.

The transceiver 3610 may transmit or receive a signal to or from a BS.The signal being transmitted or received to or from the BS may includecontrol information and data. The transceiver 3610 may include a RFtransmitter for up-converting and amplifying a frequency of a signal tobe transmitted, and an RF receiver for low-noise amplifying anddown-converting a frequency of a received signal. However, this ismerely an embodiment of the transceiver 3610, and elements of thetransceiver 3610 are not limited to the RF transmitter and the RFreceiver. Also, the transceiver 3610 may receive signals throughwireless channels and output the signals to the processor 3630, and maytransmit signals output from the processor 3630, through wirelesschannels. Also, the transceiver 3610 may transmit or receive a signal toor from the other UE. For example, when the transceiver 3610 is includedin the transmission UE, the transceiver 3610 may transmit or receive asignal to or from the reception UE. Also, when the transceiver 3610 isincluded in the reception UE, the transceiver 3610 may transmit orreceive a signal to or from the transmission UE.

According to an embodiment, the memory 3620 may store a program and datafor operations of the UE. Also, the memory 3620 may store controlinformation or data included in a signal transmitted or received by theUE. The memory 3620 may be implemented as a storage medium including aread only memory (ROM), a random access memory (RAM), a hard disk, acompact disc (CD)-ROM, a digital versatile disc (DVD), or the like, orany combination thereof. Also, the memory 3620 may be provided in amultiple number. According to an embodiment, the memory 3620 may store aprogram for performing a control operation for negotiation of parametersassociated with a point cloud session between the transmission UE andthe reception UE according to the embodiments of the present disclosure.

FIG. 37 illustrates a block diagram of a detailed configuration of atransmission UE or a reception UE according to an embodiment of thepresent disclosure. Hereinafter, in FIG. 37 , an electronic device 3710may indicate the transmission UE or the reception UE according to thepresent disclosure. However, a configuration of the transmission UE orthe reception UE is not limited to the configuration shown in FIG. 37 .That is, the transmission UE or the reception UE according to thepresent disclosure may include some of the configuration shown in FIG.37 or may include the entire configuration or may further include otherconfiguration.

Referring to FIG. 37 , the electronic device 3710 in a networkenvironment 3700 may communicate with an electronic device 3702 via afirst network 3798 (e.g.: a short-range wireless communication network)or may communicate with an electronic device 3704 or a server 3708 via asecond network 3799 (e.g., a long-range wireless communication network).According to an embodiment, the electronic device 3710 may communicatewith the electronic device 3704 via the server 3708. According to anembodiment, the electronic device 3710 may include a processor 3720, amemory 3730, an input entity 3750, an audio output entity 3755, adisplay entity 3760, an audio module 3770, a sensor module 3776, aninterface 3777, a haptic module 3779, a camera module 3780, a powermanagement module 3788, a battery 3789, a communication module 3790, asubscriber identification module 3796, or an antenna module 3797. Insome embodiments, in the electronic device 3710, at least one element(e.g.: the display entity 3760 or the camera module 3780) among theelements may be skipped or at least one other element may be added. Insome embodiments, some of the elements may be implemented as oneintegrated circuit. For example, the sensor module 3776 (e.g.: afingerprint sensor, an iris sensor, or an illuminance sensor) may beimplemented by being embedded to the display entity 3760 (e.g.: adisplay).

The processor 3720 may control at least one other element (e.g.:hardware or software element) of the electronic device 3710 connected tothe processor 3720 and may perform various data processing orcomputations, by executing software (e.g.: a program 3740). According toan embodiment, as a part of the data processing or the computations, theprocessor 3720 may load, to a volatile memory 3732, a command or datareceived from another element (e.g.: the sensor module 3776 or thecommunication module 3790), may process the command or the data storedin the volatile memory 3732, and may store resultant data in anon-volatile memory 3734.

According to an embodiment, the processor 3720 may perform a controloperation for negotiation of parameters associated with a point cloudsession between the transmission UE and the reception UE.

For example, when the processor 3720 is included in the transmission UEaccording to the present disclosure, the processor 3720 may controlelements of the transmission UE to obtain a point cloud by photographingan object, transmit, to the reception UE, a message including aparameter for point cloud transmission and reception, receive, from thereception UE, a response message including an application parameter ofthe reception UE, compress the point cloud, based on the applicationparameter of the reception UE, and transmit the compressed point cloudto the reception UE.

Alternatively, when the processor 3720 is included in the reception UEaccording to the present disclosure, the processor 3720 may controlelements of the reception UE to receive, from the transmission UE, amessage including a parameter for point cloud transmission andreception, determine an application parameter of the reception UE, basedon a channel state of the reception UE and the parameter for point cloudtransmission and reception, transmit, to the transmission UE, a responsemessage including the determined application parameter of the receptionUE, receive a point cloud from the transmission UE, and display an imageassociated with an object, based on the compressed point cloud.

According to an embodiment, the processor 3720 may include a mainprocessor 3721 (e.g., a central processing unit (CPU) or an applicationprocessor (AP)) or an auxiliary processor 3723 (e.g., a graphicsprocessing unit (GPU), an image signal processor (ISP), a sensor hubprocessor, or a communication processor (CP)) that may be operatedtogether with or independently of the main processor 3721. As anaddition or alternative, the auxiliary processor 3723 may use less powerthan the main processor 3721 or may be set to be specialized for adesignated function. The auxiliary processor 3723 may be implementedseparately from or as a part of the main processor 3721.

For example, the auxiliary processor 3723 may control at least some ofthe states or the function related to at least one element (e.g., thedisplay entity 3760, the sensor module 3776, or the communication module3790) among the elements of the electronic device 3710 on behalf of themain processor 3721 while the main processor 3721 is in an inactive(e.g., sleep) state or together with the main processor 3721 while themain processor 3721 is in an active (e.g., application execution) state.According to an embodiment, the auxiliary processor 3723 (e.g., the ISPor the CP) may be implemented as a part of another element (e.g., thecamera module 3780 or the communication module 3790) functionallyrelated thereto.

The memory 3730 may store various data to be used by at least oneelement (e.g.: the processor 3720 or the sensor module 3776) of theelectronic device 3710. The data may include, for example, software(e.g.: the program 3740) and input data or output data about commandsrelated thereto. The memory 3730 may include the volatile memory 3732 orthe non-volatile memory 3734.

The program 3740 may be stored as software in the memory 3730 and mayinclude, for example, an operating system (OS) 3742, middleware 3744, oran application 3746.

The input entity 3750 may receive a command or data to be used by anelement (e.g., the processor 3720) of the electronic device 3710, fromthe outside (e.g.: a user) of the electronic device 3710. The inputentity 3750 may include, for example, a microphone, a mouse, a keyboard,or a digital pen (e.g., a stylus pen).

The audio output module 1655 may output an audio signal to the outsideof the electronic apparatus 1601. The audio output entity 3755 mayinclude, for example, a speaker or a receiver. The speaker may be usedfor general purposes such as reproduction of multimedia or reproductionof recording, and the receiver may be used to receive incoming calls.According to an embodiment, the receiver may be implemented separatelyfrom or as a part of the speaker.

The display entity 3760 may visually provide information to the outside(e.g., the user) of the electronic device 3710. The display entity 3760may include, for example, a display, a hologram display device, or aprojector, and a control circuit for controlling the correspondingdevice. According to an embodiment, the display entity 3760 may includea touch circuitry configured to detect a touch or a sensor circuitry(e.g.: a pressure sensor) configured to measure the strength of a forcegenerated by the touch.

According to an embodiment, when the display entity 3760 is included inthe reception UE, the display entity 3760 may include an AR display fordisplaying the point cloud received from the transmission UE. In thiscase, the reception UE may display an AR image of a part of an objectsuch as human or thing.

The audio module 3770 may convert a sound into an electric signal orconvert an electric signal into a sound. According to an embodiment, theaudio module 3770 may obtain a sound via the input entity 3750 or mayoutput a sound via the audio output entity 3755 or an externalelectronic device (e.g., the electronic device 3702) (e.g., a speaker ora headphone) directly or wirelessly connected to the electronic device3710.

The sensor module 3776 may detect an operating state (e.g.: power ortemperature) of the electronic device 3710 or an external environmentalstate (e.g., user state) and may generate an electrical signal or datavalue corresponding to the detected state. According to an embodiment,the sensor module 3776 may include, for example, a gesture sensor, agyro sensor, a barometric pressure sensor, a magnetic sensor, anacceleration sensor, a grip sensor, a proximity sensor, a color sensor(e.g.: RGB sensors), an infrared (IR) sensor, a biometric sensor, atemperature sensor, a humidity sensor, an illuminance sensor, or sensors(e.g.: an inertial measurement unit (IMU), a global positioning system(GPS) sensor, a camera, light imaging detection and ranging (LIDAR),radio detection and ranging (RADAR), or the like) related to anautonomous driving car.

The interface 3777 may support one or more designated protocols that maybe used by the electronic device 3710 to be directly or wirelesslyconnected to an external electronic device (e.g.: the electronic device3702). According to an embodiment, the interface 3777 may include, forexample, a high definition multimedia interface (HDMI), a universalserial bus (USB) interface, a secure digital (SD) card interface, or anaudio interface.

A connection terminal 3778 may include a connector via which theelectronic device 3710 may be physically connected to an externalelectronic device (e.g.: the electronic device 3702). According to anembodiment, the connection terminal 3778 may include, for example, anHDMI connector, a USB connector, an SD card connector, or an audioconnector (e.g., a headphone connector).

The haptic module 3779 may convert an electrical signal into amechanical stimulus (e.g., vibration or movement) or an electricalstimulus that the user may recognize via a haptic or kinesthetic sense.According to an embodiment, the haptic module 3779 may include, forexample, a motor, a piezoelectric element, or an electrical stimulationdevice.

The camera module 3780 may capture still images and moving images.According to an embodiment, the camera module 3780 may include one ormore lenses, image sensors, image signal processors, or flashes.

According to an embodiment, when the camera module 3780 is included inthe transmission UE, the camera module 3780 may obtain a point cloud byphotographing an object such as human or thing.

The power management module 3788 may manage power supplied to theelectronic device 3710. According to an embodiment, the power managementmodule 3788 may be implemented as, for example, at least a part of apower management integrated circuit (PMIC).

The battery 3789 may supply power to at least one element of theelectronic device 3710. According to an embodiment, the battery 3789 mayinclude, for example, a non-rechargeable primary cell, a rechargeablesecondary cell, or a fuel cell.

The communication module 3790 may support establishment of a direct(e.g., wired) communication channel or a wireless communication channelbetween the electronic device 3710 and an external electronic device(e.g., the electronic device 3702, the electronic device 3704, or theserver 3708) and performance of communication via the establishedcommunication channel. The communication module 3790 may include one ormore communication processors that operate independently of theprocessor 3720 (e.g.: an application processor) and support direct(e.g., wired) communication or wireless communication. According to anembodiment, the communication module 3790 may include a wirelesscommunication module 3792 (e.g.: a cellular communication module, ashort-range communication module, or a global navigation satellitesystem (GNSS) communication module) or a wired communication module 3794(e.g., a local area network (LAN) communication module or a power linecommunication module). The corresponding communication module amongthese communication modules may communicate with the external electronicdevice via the first network 3798 (e.g., a short-range communicationnetwork such as Bluetooth, wireless fidelity direct (Wi-Fi direct), orinfrared data association (IrDA)) or the second network 3799 (e.g., along-range communication network such as a cellular network, theInternet, or a computer network (e.g., LAN or WAN)). Alternatively, thecommunication module may communicate with an external electronic devicevia a sidelink of LTE or 5G which uses an unlicensed spectrum or Wi-Fidirect. These various types of communication modules may be integratedinto one element (e.g., a single chip) or may be implemented as aplurality of elements (e.g., multiple chips) that separate from eachother.

The wireless communication module 3792 may identify and authenticate theelectronic device 3710 in a communication network such as the firstnetwork 3798 or the second network 3799 by using subscriber information(e.g., international mobile subscriber identity (IMSI)) stored in thesubscriber identification module 3796.

The antenna module 3797 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device). According to anembodiment, the antenna module 3797 may include an antenna including aconductor formed on a substrate (e.g., a printed circuit board (PCB)) ora radiator including a conductive pattern. According to an embodiment,the antenna module 3797 may include a plurality of antennas. In thiscase, at least one antenna appropriate for a communication scheme usedin a communication network such as the first network 3798 or the secondnetwork 3799 may be selected from among the plurality of antennas by,for example, the communication module 3790. The signal or power may betransmitted or received between the communication module 3790 and theexternal electronic device via the selected at least one antenna.According to some embodiments, other elements (e.g., a radio frequencyintegrated circuit (RFIC)) in addition to the radiator may beadditionally formed as a part of the antenna module 3797.

At least some of the above elements may be connected to each other via acommunication scheme between peripheral devices (e.g., bus,general-purpose input and output (GPIO), serial peripheral interface(SPI), or mobile industry processor interface (MIPI)) and may exchangesignals (e.g., command or data) with each other.

According to an embodiment, the command or data may be transmitted orreceived between the electronic device 3710 and the external electronicdevice 3704 via the server 3708 connected to the second network 3799.Each of the external electronic devices 3702 and 3704 may be the same asor different from the electronic device 3710.

According to an embodiment, all or some of the operations executed bythe electronic device 3710 may be executed by one or more externalelectronic devices among the external electronic devices 3702, 3704 and3708. For example, when the electronic device 3710 needs to perform afunction or service automatically or in response to a request from theuser or another device, the electronic device 3710 may request the oneor more external electronic devices 3702 and 3704 to perform at least aportion of the function or service additionally or instead of executingthe function or service by itself. The one or more external electronicdevices 3702 and 3704 that have received the request may execute atleast a portion of the requested function or service or an additionalfunction or service related to the request and may transmit theexecution result thereof to the electronic device 3710. The electronicdevice 3710 may provide the execution result as it is or mayadditionally process and provide the processing result thereof as atleast a portion of a response to the request.

According to an embodiment of the present disclosure, an operatingmethod of a transmission UE in a wireless communication system mayinclude obtaining a point cloud by photographing an object,transmitting, to a reception UE, a message including a parameter fortransmission and reception of the point cloud, wherein the parameter fortransmission and reception of the point cloud includes at least one of aparameter associated with a direction of the object or a space parameterassociated with the object, receiving, from the reception UE, a responsemessage including an application parameter of the reception UE, whereinthe application parameter of the reception UE is determined based on theparameter for transmission and reception of the point cloud and achannel state of the reception UE, compressing the point cloud, based onthe application parameter of the reception UE, and transmitting, to thereception UE, the compressed point cloud.

According to an embodiment, the parameter associated with the directionof the object may indicate a display direction of the object on an imagewhen the object is displayed on the image by the reception UE, and theparameter for transmission and reception of the point cloud may includean indicator indicating whether to use the parameter associated with thedirection of the object.

According to an embodiment, the parameter for transmission and receptionof the point cloud may include an indicator indicating whether to usethe space parameter associated with the object, and the space parameterassociated with the object may include at least one of informationindicating a scheme of segmenting the object into one or more regions orinformation indicating the one or more regions.

According to an embodiment, the parameter for transmission and receptionof the point cloud may include at least one of resolution information ofan image buffer associated with the compressing of the point cloud, typeinformation of the image buffer, count information of the point cloud,transfer rate information of the point cloud, patch size information ofthe point cloud, information indicating a priority between the countinformation of the point cloud and the patch size information of thepoint cloud.

According to an embodiment of the present disclosure, an operatingmethod of a reception UE in a wireless communication system may includereceiving, from a transmission UE, a message including a parameter fortransmission and reception of a point cloud, and obtaining the pointcloud by photographing an object, wherein the parameter for transmissionand reception of the point cloud includes at least one of a parameterassociated with a direction of the object or a space parameterassociated with the object, determining an application parameter of thereception UE, based on a channel state of the reception UE and theparameter for transmission and reception of the point cloud,transmitting, to the transmission UE, a response message including thedetermined application parameter of the reception UE, receiving, fromthe transmission UE, the point cloud, wherein the point cloud iscompressed based on the application parameter of the reception UE, anddisplaying an image associated with the object, based on the compressedpoint cloud.

According to an embodiment, the parameter associated with the directionof the object may indicate a display direction of the object on an imagewhen the object is displayed on the image by the reception UE, and theparameter for transmission and reception of the point cloud may includean indicator indicating whether to use the parameter associated with thedirection of the object.

According to an embodiment, the determining of the application parameterof the reception UE may include identifying, from the parameter fortransmission and reception of the point cloud, the indicator indicatingwhether to use the parameter associated with the direction of theobject, and determining at least one among display directions of theobject, based on the channel state of the reception UE or apredetermined reference.

According to an embodiment, the parameter for transmission and receptionof the point cloud may include an indicator indicating whether to usethe space parameter associated with the object, and the space parameterassociated with the object may include at least one of informationindicating a scheme of segmenting the object into one or more regions orinformation indicating the one or more regions associated with theobject.

According to an embodiment, the determining of the application parameterof the reception UE may include identifying, from the parameter fortransmission and reception of the point cloud, the indicator indicatingwhether to use the space parameter associated with the object, anddetermining at least one among a plurality of pieces of informationindicating the one or more regions associated with the object, based onthe channel state of the reception UE or a predetermined reference.

According to an embodiment, the parameter for transmission and receptionof the point cloud may include at least one of resolution information ofan image buffer associated with the compressing of the point cloud, typeinformation of the image buffer, count information of the point cloud,transfer rate information of the point cloud, patch size information ofthe point cloud, information indicating a priority between the countinformation of the point cloud and the patch size information of thepoint cloud.

According to an embodiment of the present disclosure, a transmission UEin a wireless communication system may include a transceiver, and atleast one processor configured to

-   obtain a point cloud by photographing an object, transmit, to a    reception UE via the transceiver, a message including a parameter    for transmission and reception of the point cloud, wherein the    parameter for transmission and reception of the point cloud includes    at least one of a parameter associated with a direction of the    object or a space parameter associated with the object,-   receive, from the reception UE via the transceiver, a response    message including an application parameter of the reception UE,    wherein the application parameter of the reception UE is determined    based on the parameter for transmission and reception of the point    cloud and a channel state of the reception UE, compress the point    cloud, based on the application parameter of the reception UE, and    transmit, to the reception UE via the transceiver, the compressed    point cloud.

According to an embodiment, the parameter associated with the directionof the object may indicate a display direction of the object on an imagewhen the object is displayed on the image by the reception UE, and theparameter for transmission and reception of the point cloud may includean indicator indicating whether to use the parameter associated with thedirection of the object.

According to an embodiment, the parameter for transmission and receptionof the point cloud may include an indicator indicating whether to usethe space parameter associated with the object, and the space parameterassociated with the object may include at least one of informationindicating a scheme of segmenting the object into one or more regions orinformation indicating the one or more regions.

According to an embodiment, the parameter for transmission and receptionof the point cloud may include at least one of resolution information ofan image buffer associated with the compressing of the point cloud, typeinformation of the image buffer, count information of the point cloud,transfer rate information of the point cloud, patch size information ofthe point cloud, information indicating a priority between the countinformation of the point cloud and the patch size information of thepoint cloud.

According to an embodiment of the present disclosure, a reception UE ina wireless communication system may include a transceiver, and at leastone processor configured to receive, from a transmission UE via thetransceiver, a message including a parameter for transmission andreception of a point cloud, and obtain the point cloud by photographingan object, wherein the parameter for transmission and reception of thepoint cloud includes at least one of a parameter associated with adirection of the object or a space parameter associated with the object,determine an application parameter of the reception UE, based on achannel state of the reception UE and the parameter for transmission andreception of the point cloud, transmit, to the transmission UE via thetransceiver, a response message including the determined applicationparameter of the reception UE, receive, from the transmission UE via thetransceiver, the point cloud, wherein the point cloud is compressedbased on the application parameter of the reception UE, and display animage associated with the object, based on the compressed point cloud.

According to an embodiment, the parameter associated with the directionof the object may indicate a display direction of the object on an imagewhen the object is displayed on the image by the reception UE, and theparameter for transmission and reception of the point cloud may includean indicator indicating whether to use the parameter associated with thedirection of the object.

According to an embodiment, the at least one processor may be configuredto identify, from the parameter for transmission and reception of thepoint cloud, the indicator indicating whether to use the parameterassociated with the direction of the object, and determine at least oneamong display directions of the object, based on the channel state ofthe reception UE or a predetermined reference.

According to an embodiment, the parameter for transmission and receptionof the point cloud may include an indicator indicating whether to usethe space parameter associated with the object, and the space parameterassociated with the object may include at least one of informationindicating a scheme of segmenting the object into one or more regions orinformation indicating the one or more regions associated with theobject.

According to an embodiment, the at least one processor may be configuredto identify, from the parameter for transmission and reception of thepoint cloud, the indicator indicating whether to use the space parameterassociated with the object, and determine at least one among a pluralityof pieces of information indicating the one or more regions associatedwith the object, based on the channel state of the reception UE or apredetermined reference.

According to an embodiment, the parameter for transmission and receptionof the point cloud may include at least one of resolution information ofan image buffer associated with the compressing of the point cloud, typeinformation of the image buffer, count information of the point cloud,transfer rate information of the point cloud, patch size information ofthe point cloud, information indicating a priority between the countinformation of the point cloud and the patch size information of thepoint cloud.

The methods according to the embodiments described in the claims or thedetailed description of the present disclosure may be implemented inhardware, software, or a combination of hardware and software.

When the methods are implemented in software, a computer-readablestorage medium or a computer program product having one or more programs(software modules) stored therein may be provided. The one or moreprograms stored in the computer-readable storage medium or the computerprogram product are configured to be executable by one or moreprocessors in an electronic device. The one or more programs includeinstructions to cause the electronic device to execute the methodsaccording to the embodiments described in the claims or the detaileddescription of the present disclosure.

The programs (e.g., software modules or software) may be stored inrandom access memory (RAM), non-volatile memory including flash memory,read only memory (ROM), electrically erasable programmable read-onlymemory (EEPROM), a magnetic disc storage device, a CD-ROM, digitalversatile discs (DVD), another type of optical storage device, or amagnetic cassette. Alternatively, the programs may be stored in a memoryincluding a combination of some or all of the above-mentioned memorydevices. In addition, each memory may refer to a plurality of memories.

Also, the programs may be stored in an attachable storage device whichis accessible via a communication network such as the Internet, anintranet, a local area network (LAN), a wireless LAN (WLAN), or astorage area network (SAN), or a combination thereof. The storage devicemay be connected via an external port to an apparatus according to theembodiments of the present disclosure. Also, another storage device onthe communication network may be connected to the apparatus performingthe embodiments of the present disclosure.

In the present disclosure, the terms “computer program product” or“computer-readable recording medium” are used to totally indicate amedium such as a memory, a hard disc mounted in a hard disk drive, and asignal. The “computer program product” or the “computer-readablerecording medium” is a means to be provided to the method of controllingtransmission or reception of data in a wireless communication systemaccording to the present disclosure.

In the afore-described embodiments of the present disclosure, elementsincluded in the present disclosure are expressed in a singular or pluralform according to the embodiments. However, the singular or plural formis appropriately selected for convenience of descriptions and thepresent disclosure is not limited thereto. As such, an element expressedin a plural form may also be configured as a single element, and anelement expressed in a singular form may also be configured as pluralelements.

Specific embodiments are described in the description of the presentdisclosure, but it will be understood that various modifications may bemade without departing the scope of the present disclosure. Thus, thescope of the present disclosure is not limited to the embodimentsdescribed herein and should be defined by the appended claims and theirequivalents.

1. An operating method of a transmission user equipment (UE) in awireless communication system, the operating method comprising:obtaining a point cloud corresponding to an object; transmitting, to areception UE, a message comprising a parameter for transmission andreception of the point cloud, wherein the parameter for transmission andreception of the point cloud comprises at least one of a parameterassociated with a direction of the object or a space parameterassociated with the object; receiving, from the reception UE, a responsemessage comprising an application parameter of the reception UE, whereinthe application parameter of the reception UE is determined based on theparameter for transmission and reception of the point cloud and achannel state of the reception UE; compressing the point cloud, based onthe application parameter of the reception UE; and transmitting, to thereception UE, the compressed point cloud.
 2. The operating method ofclaim 1, wherein the parameter associated with the direction of theobject indicates a display direction of the object on an image when theobject is displayed on the image by the reception UE, and wherein theparameter for transmission and reception of the point cloud comprises anindicator indicating whether to use the parameter associated with thedirection of the object.
 3. The operating method of claim 1, wherein theparameter for transmission and reception of the point cloud comprises anindicator indicating whether to use the space parameter associated withthe object, and wherein the space parameter associated with the objectcomprises at least one of information indicating a scheme of segmentingthe object into one or more regions or information indicating the one ormore regions.
 4. The operating method of claim 1, wherein the parameterfor transmission and reception of the point cloud comprises at least oneof resolution information of an image buffer associated with thecompressing of the point cloud, type information of the image buffer,count information of the point cloud, transfer rate information of thepoint cloud, patch size information of the point cloud, informationindicating a priority between the count information of the point cloudand the patch size information of the point cloud.
 5. An operatingmethod of a reception user equipment (UE) in a wireless communicationsystem, the operating method comprising: receiving, from a transmissionUE, a message comprising a parameter for transmission and reception of apoint cloud corresponding to an object, wherein the parameter fortransmission and reception of the point cloud comprises at least one ofa parameter associated with a direction of the object or a spaceparameter associated with the object; determining an applicationparameter of the reception UE, based on a channel state of the receptionUE and the parameter for transmission and reception of the point cloud;transmitting, to the transmission UE, a response message comprising thedetermined application parameter of the reception UE; receiving, fromthe transmission UE, the point cloud, wherein the point cloud iscompressed based on the application parameter of the reception UE; anddisplaying an image associated with the object, based on the compressedpoint cloud.
 6. The operating method of claim 5, wherein the parameterassociated with the direction of the object indicates a displaydirection of the object on an image when the object is displayed on theimage by the reception UE, and wherein the parameter for transmissionand reception of the point cloud comprises an indicator indicatingwhether to use the parameter associated with the direction of theobject.
 7. The operating method of claim 6, wherein the determining ofthe application parameter of the reception UE comprises: identifying,from the parameter for transmission and reception of the point cloud,the indicator indicating whether to use the parameter associated withthe direction of the object; and determining at least one among displaydirections of the object, based on the channel state of the reception UEor a predetermined reference.
 8. The operating method of claim 5,wherein the parameter for transmission and reception of the point cloudcomprises an indicator indicating whether to use the space parameterassociated with the object, and wherein the space parameter associatedwith the object comprises at least one of information indicating ascheme of segmenting the object into one or more regions or informationindicating the one or more regions associated with the object.
 9. Theoperating method of claim 8, wherein the determining of the applicationparameter of the reception UE comprises: identifying, from the parameterfor transmission and reception of the point cloud, the indicatorindicating whether to use the space parameter associated with theobject; and determining at least one among a plurality of pieces ofinformation indicating the one or more regions associated with theobject, based on the channel state of the reception UE or apredetermined reference.
 10. The operating method of claim 5, whereinthe parameter for transmission and reception of the point cloudcomprises at least one of resolution information of an image bufferassociated with the compressing of the point cloud, type information ofthe image buffer, count information of the point cloud, transfer rateinformation of the point cloud, patch size information of the pointcloud, information indicating a priority between the count informationof the point cloud and the patch size information of the point cloud.11. A transmission user equipment (UE) in a wireless communicationsystem, the transmission UE comprising: a transceiver; and at least oneprocessor configured to: obtain a point cloud corresponding to anobject, transmit, to a reception UE via the transceiver, a messagecomprising a parameter for transmission and reception of the pointcloud, wherein the parameter for transmission and reception of the pointcloud comprises at least one of a parameter associated with a directionof the object or a space parameter associated with the object, receive,from the reception UE via the transceiver, a response message comprisingan application parameter of the reception UE, wherein the applicationparameter of the reception UE is determined based on the parameter fortransmission and reception of the point cloud and a channel state of thereception UE, compress the point cloud, based on the applicationparameter of the reception UE, and transmit, to the reception UE via thetransceiver, the compressed point cloud.
 12. The transmission UE ofclaim 11, wherein the parameter associated with the direction of theobject indicates a display direction of the object on an image when theobject is displayed on the image by the reception UE, and wherein theparameter for transmission and reception of the point cloud comprises anindicator indicating whether to use the parameter associated with thedirection of the object.
 13. The transmission UE of claim 11, whereinthe parameter for transmission and reception of the point cloudcomprises an indicator indicating whether to use the space parameterassociated with the object, and wherein the space parameter associatedwith the object comprises at least one of information indicating ascheme of segmenting the object into one or more regions or informationindicating the one or more regions.
 14. The transmission UE of claim 11,wherein the parameter for transmission and reception of the point cloudcomprises at least one of resolution information of an image bufferassociated with the compressing of the point cloud, type information ofthe image buffer, count information of the point cloud, transfer rateinformation of the point cloud, patch size information of the pointcloud, information indicating a priority between the count informationof the point cloud and the patch size information of the point cloud.15. A reception user equipment (UE) in a wireless communication system,the reception UE comprising: a transceiver; and at least one processorconfigured to: receive, from a transmission UE, a message comprising aparameter for transmission and reception of a point cloud correspondingto an object, wherein the parameter for transmission and reception ofthe point cloud comprises at least one of a parameter associated with adirection of the object or a space parameter associated with the object,determine an application parameter of the reception UE, based on achannel state of the reception UE and the parameter for transmission andreception of the point cloud, transmit, to the transmission UE, aresponse message comprising the determined application parameter of thereception UE, receive, from the transmission UE, the point cloud,wherein the point cloud is compressed based on the application parameterof the reception UE, and display an image associated with the object,based on the compressed point cloud.
 16. The reception UE of claim 15,wherein the parameter associated with the direction of the objectindicates a display direction of the object on an image when the objectis displayed on the image by the reception UE, and wherein the parameterfor transmission and reception of the point cloud comprises an indicatorindicating whether to use the parameter associated with the direction ofthe object.
 17. The reception UE of claim 16, wherein the at least oneprocessor is further configured to: identify, from the parameter fortransmission and reception of the point cloud, the indicator indicatingwhether to use the parameter associated with the direction of theobject, and determine at least one among display directions of theobject, based on the channel state of the reception UE or apredetermined reference.
 18. The reception UE of claim 15, wherein theparameter for transmission and reception of the point cloud comprises anindicator indicating whether to use the space parameter associated withthe object, and wherein the space parameter associated with the objectcomprises at least one of information indicating a scheme of segmentingthe object into one or more regions or information indicating the one ormore regions associated with the object.
 19. The reception UE of claim18, wherein the at least one processor is further configured to:identify, from the parameter for transmission and reception of the pointcloud, the indicator indicating whether to use the space parameterassociated with the object, and determine at least one among a pluralityof pieces of information indicating the one or more regions associatedwith the object, based on the channel state of the reception UE or apredetermined reference.
 20. The reception UE of claim 15, wherein theparameter for transmission and reception of the point cloud comprises atleast one of resolution information of an image buffer associated withthe compressing of the point cloud, type information of the imagebuffer, count information of the point cloud, transfer rate informationof the point cloud, patch size information of the point cloud,information indicating a priority between the count information of thepoint cloud and the patch size information of the point cloud.